Forward. 

These are step-by-verifiable-step notes designed to take students with a year of calculus based 
physics who are about to enroll in ordinary differential equations all the way to doctoral foundations in 
either mathematics and physics without mystery. Abstract algebra, topology (local and global) folds into 
a useful, intuitive toolset for ordinary differential equations and partial differential equations, be they 
linear or nonlinear. The algebraist, the topologist, the theoretical physicist, the applied mathematician 
and experimental physicist are artificial distinctions at the core. There is unity. 

Mathematician, you will see step-by-verifiable-step algebra, topology (local and global) in a 
unified framework to treat differential equations, ordinary, partial, linear and nonlinear. You will then 
see why the physicists created a great font of differential equations, the calculus of variations. You will 
see why the physicists care about both discrete and continuous (topological) Lie groups and understand 
what quantum mechanics is as a mathematical system from its various historical classical physical roots: 
Lagrangian mechanics, Hamiltonian mechanics, Poisson brackets. You will have the tools to understand 
the Standard Model of physics and some of our main paths forward to grand unified theories and 
theories of everything. With these notes you should never again be able to practice abstraction for the 
sake of abstraction. Physicist, you will not be held hostage to verbiage and symbology. You will see that 
mathematics has deep, unavoidable limitations that underlie physics, itself suffering unavoidable 
limitations. You will see unity, e.g., summing angular momentum in terms of tensor products and 
directions sums, ladder operators, Young's tableaux, root and weigh diagrams as different codifications 
of the same thing. Neither of you have to take your required courses as exercises in botany and voodoo 
as exemplified by ordinary differential equations. You will have context and operational skills. As 
lagniappes you will have the calculus of variations, the fractional calculus, stochastic calculus and 
stochastic differential equations. 



Contents 

Part I . (p. 1) Assuming only a mathematical background up to a sophomore level course in 
ordinary differential equations, Part I treats the application of symmetry methods for differential 
equations, be they linear, nonlinear, ordinary or partial. The upshot is the development of a naturally 
arising, systematic abstract algebraic toolset for solving differential equations that simultaneously binds 
abstract algebra to differential equations, giving them mutual context and unity. In terms of a semester 
of study, this material would best follow a semester of ordinary differential equations. The algorithmics, 
which will be developed step by step with plenty of good examples proceed along as follows: (1) learn to 
use the linearized symmetry condition to determine the Lie point symmetries, (2) calculate the 
commutators of the basis generators and hence the sequence of derived subalgebras, (3) find a 
sufficiently large solvable subalgebra, choose a canonical basis, calculate the fundamental differential 
invariants, and (4) rewrite the differential equation in terms of any differential invariants; then use each 
generator in turn to carry out one integration. This sounds like a mouthful, but you will see that it is not. 
The material is drawn from my notes derived from "Symmetry Methods for Differential Equations: A 
Beginner's Guide," Peter E. Hydon, Cambridge University Press, 2000. 

Part II . (p. 125) Part II which assumes no additional background, should be learned in parallel 
with Part I. Part II builds up the calculus of variations by paralleling the buildup of undergraduate 
elementary calculus. Present day physics including classical mechanics, electrodynamics, quantum 
physics, quantum field theories, general relativity, string theories, and loop quantum gravity, for 
example, are all expressed in terms of some variational principle extremizing some action. This 
extremization process leads to, through the calculus of variations, sets of differential equations. These 
differential equations have associated symmetries (Part I) that underlie our present understanding of 
fundamental physics, the Standard Model. The same goes for many of the theoretical symmetries 
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stretching beyond the Standard Model such as grand unified theories (GUTs) with or without 
supersymmetry (SUSY), and theories of everything (TOEs) like string theories. We will buttress the use 
of this variational toolset with history. Part II will thus provide us a deep, practical, intuitive source of 
differential equations, while Part I places the investigation of these differential equations in a general, 
practical, intuitive, algebraic framework readily accessible to the college sophomore. The variational 
material is drawn from "Calculus of Variations (Dover Books on Mathematics)," Lev D. Elsgolc, Dover 
Publications, 2007. 

Beyond the sophomore level material contained in Parts I and II, a student pursuing deeper 
studies in either physics or mathematics will have already been well served by these notes, forever 
understanding that most abstract mathematics is likely clothed within a rich, intuitively unified, and 
useful context, and that any voodoo mathematical prescriptions in physics can be deconstructed from a 
relatively small collection of fundamental mathematical tools and physical principles. It would be 
desirable, but not necessary for studying Parts I and II, to have had some junior level exposure to 
classical mechanics motivating the calculus of variations. In lieu of this, I strongly recommend parallel 
readings from "Variational Principles In Dynamics and Quantum Theory (Dover Books on Physics)", 
Wolfgang Yourgrau and Stanley Mandelstam, Dover Publications, 1979 to tie the calculus of variations to 
mechanics, quantum mechanics and beyond through the historical development of this field from 
Fermat to Feynman. 

Part III , (p. 136) Part III culminates the unifying goal of Parts I and II at the junior level, intuitively 
unifying algebra and topology together into algebraic topology with applications to differential 
equations and physics. Whereas in Part I students learn to study the sub-algebraic structure of the 
commutators of a differential equation to learn if a given differential equation may be more readily 
solved in new coordinates and/or reduced in order, Part III begins to develop the topological linkage of 
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commutators to quantum field theories and general relativity by intuitively developing the concepts 
underlying parallel transport and the covariant derivative. This picture is developed step-by-step free of 
hand waving. It is recommended that the material in Part III be studied in parallel with a traditional 
junior level course in partial differential equations. If you are doing Part III solo, the parallel material for 
partial differential equations can be found in, "Applied Partial Differential Equations with Fourier Series 
and Boundary Value Problems," 4 th ed., Richard Haberman, Prentice Hall, 2003— a great text in any 
edition. Having a junior level background in classical mechanics up to the Lagrangian and Hamiltonian 
approaches would greatly add to the appreciation of Parts I, II, and III. In lieu of this background is a 
reading of the previously cited Dover history book by Wolfgang Yourgrau and Stanley Mandelstam. The 
material covering algebraic topology and differential equations is drawn from the first four chapters of 
"Lie Groups, Lie Algebras, and Some of Their Applications (Dover Books on Mathematics)", Robert 
Gilmore, Dover Publications, 2006. Part III cleans up and fills in Gilmore's Dover book. The nitty gritty 
connections to quantum field theories and general relativity can be further elaborated from reading 
chapter three of "Quantum Field Theory," 2 nd ed., Lewis H. Ryder, Cambridge University Press, 1996, and 
from "A Short Course in General Relativity," 3 rd ed., James A. Foster and J. David Nightingale, Springer, 
2005. The latter book provides a step by step construction of general relativity including the concept of 
parallel transport and the covariant derivative from a geometric point of view. 

Part IV . (p. 207) In Part IV machinery is built up to study the group theoretic structures 
associated, not with differential equations this time, but with polynomials to prove the insolvability of 
the quintic, now providing the student with two examples of the utility of abstract algebra and linear 
algebra to problems in mathematics. As we develop this machinery, we will study the properties of the 
irreducible representations of discrete groups with applications to crystallography, molecular vibrations, 
and quantum physics. The toolset is then extended to continuous groups with applications to quantum 
physics and particle physics. It will be shown how to use ladder algebras to solve quantum mechanical 
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differential equations algebraically. No step will be left out to mystify students. The material dealing 
with the insolvability of the quintic and discrete groups is pulled from two sources, Chapter 1 of "Lie 
Groups, Physics, and Geometry: An Introduction for Physicists, Engineers and Chemists," Robert 
Gilmore, Cambridge University Press, 2008, and from the first four chapters of the first edition of 
"Groups, Representations and Physics," 2 nd ed., H. F. Jones, Institute of Physics Publishing, 1998. The 
latter, 2008 book by Robert Gilmore is too fast paced, and too filled with hand waving to serve other 
than as a guide for what is important to learn after learning the material presented in this work. The 
material dealing with continuous groups is derived from many sources which I put together into a set of 
notes to better understand "An Exceptionally Simple Theory of Everything," A. Garrett Lisi, 
arXiv:0711.0770vl, 6 November 2007. 

A note on freebies. It is assumed that the student will take a course in complex analysis at the 
level of any late edition of "Complex Variables and Applications," James W. Brown and Ruel V. Churchill, 
McGraw-Hill Science/Engineering/Math, 8 th ed., 2008. Strongly recommended are one or two good 
courses in linear algebra. A physics student, typically at the graduate level, is usually required to take a 
semester of mathematical physics covering a review of undergraduate mathematics and a treatment of 
special functions and their associated, physics-based differential equations. Once again the student is 
back to studying botany, and once again symmetry groups unify the botany. A free book treating this 
can be downloaded from http://www.ima.umn.edu/~miller/lietheoryspecialfunctions.html ("Lie Theory 
and Special Functions," by Willard Miller, Academic Press, New York, 1968 (out of print)). 

A note on step-by-step books. "Introduction to Electrodynamics," 3 rd ed., David J. Griffiths, 
Benjamin Cummings, 1999, or equivalent level of junior level electrodynamics, "Quantum 
Electrodynamics," 3 rd ed., Greiner and Reinhardt, Springer 2002, and "Quantum Field Theory," 2 nd ed., 
Lewis H. Ryder, Cambridge University Press, 1996 are each excellent, clearly written and self-contained. 
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Griffiths should be read from end to end. Greiner and Reinhardt should be read up to at least chapter 
four, if not up to chapter five to gain hands-on experience with calculating cross sections and decay 
rates the old fashioned way that led Richard Feynman to develop the Feynman diagram approach. The 
introductory chapter of Ryder may be skipped. Chapters two and three are where the physics and the 
mathematics lay that are relevant to much of the material presented in this work. The introductory 
chapter on path integrals is also pertinent. 

Part V . (p. 294) Part V treats a miscellany of topics. Principal among these topics is material 
drawn from "The Fractional Calculus, Theory and Applications of Differentiation and Integration to 
Arbitrary Order (Dover Books on Mathematics)" by Keith B. Oldham and Jerome Spanier, Dover 
Publications, 2006. You will not only come to appreciate the gamma function better, you will be able to 
ask if the V^r th derivative has any meaning. Who said we can only take 1 st , 2 nd ,...,n th order derivatives, or 
integrate once, twice,. ..,or n times? Calculus is more general, more unified, more intuitive, and more 
physical than calculus with only integer order differentiation or integration. The conversation will then 
turn to stochastic processes (p. 301). In my studies, I found measure theoretic analysis to be another 
source of meaningless, isolated, dry crap until I got into financial physics and needed to work with 
stochastic differential equations. Finance and statistical physics, to a lesser extent as currently taught in 
graduate physics courses, give context to measure theory. Material to show this is taken from "Options, 
Futures, and Other Derivatives," 5 th (or higher) edition, John C. Hull, Prentice Hall, 2002, as well as from 
personal notes. 

Here is a final word to the physicists. Parts I and II of this work go to support graduate level 
classical mechanics and its extensions to quantum physics and quantum field theory. You should 
buttress your understanding of classical mechanics beyond the standard graduate course covering the 
material in, say, "Classical Mechanics," 3 rd ed., Herbert Goldstein, Addison Wesley, 2001. Goldstein 



certainly provides a good treatment of classical mechanics, giving the reader the background underlying 
the development of quantum physics, but he does not cover continuum mechanics. Continuum 
mechanics is not just for the engineer. The development of tensors and dyadic tensors is far greater in 
continuum mechanics than in typical, introductory general relativity. It is your loss not to acquire this 
more general toolset. I recommend, "Continuum Mechanics (Dover Books on Physics)," A. J. M. 
Spencer, Dover Publications, 2004. To complete one's understanding of mechanics, one should also 
study "Exploring Complexity," G. Nicolis and I. Prigogine, W H Freeman, 1989. Moving from complexity 
to statistical physics, my favorite statistical physics book is "A Modern Course in Statistical Physics," 
Linda E. Reichl, Wiley-VCH, 2009 (or its older edition). For experience solving practical problems, study 
"Statistical Mechanics (North-Holland Personal Library)", R. Kubo, H. Ichimura, T. Usui, and N. 
Hashitsume, North Holland, 1990. Underlying statistical physics is thermodynamics. I recommend 
"thermodynamics (Dover Books on Physics)" by Enrico Fermi, Dover Publications, 1956. "An 
Introduction to equations of state: theory and applications" by S. Eliezer, A. G. Ghatak and H. Hora 
(1986) gives a pretty good treatment of where our knowledge in thermodynamics and statistical physics 
abuts our ignorance, as well as shows how quickly mathematical models and methods become complex, 
difficult and approximate. This compact book has applications far outside of weapons work to work in 
astrophysics and cosmology. Rounding out some of the deeper meaning behind statistical physics is 
information theory, I recommend reading "The Mathematical Theory of Communication" by Claude E. 
Shannon and Warren Weaver, University of Illinois Press, 1998, and "An Introduction to Information 
Theory, Symbols, Signals and Noise" by John R. Pierce (also from Bell Labs), Dover Publications Inc., 
1980. The material covered in Part V on measure theory and stochastic differential equations fits well 
with the study of statistical physics. 

Parts I and II also go to the study of electrodynamics, undergraduate and graduate. At the 
graduate level ("Classical Electrodynamics," 3 rd ed., John D. Jackson, Wiley, 1998) one is inundated with 
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differential equations and their associated special functions. The online text by Willard Miller tying 
special functions to Lie symmetries is very useful at this point. I also recommend an old, recently 
reprinted book, "A Course of Modern Analysis," E. T. Whittaker, Book Jungle, 2009. The historical 
citations, spanning centuries, are exhaustive. 

Parts I through V of this work underlie studies in general relativity, quantum mechanics, 
quantum electrodynamics and other quantum field theories. With this background you will have better 
luck reading books like, "A First Course in Loop Quantum Gravity," R. Gambini and J. Pullin, Oxford 
University Press, 2011, and "A First Course in String Theory," Barton Zweibach, 2 nd ed., Cambridge 
University Press, 2009. Again, only together do mathematics and physics provide us with a general, 
intuitive grammar and powerful, readily accessible tools to better understand and explore nature and 
mathematics, and even to help us dream and leap beyond current physics and mathematics. Before you 
get deep into particle physics, I recommend starting with "Introduction to Elementary Particles," 2 nd ed., 
David Griffiths, Wiley-VCH, 2008. 

A. Alaniz 

Apologies for typos in this first edition, December 2012. Teaching should be more than about how, but 
also about why and what for. Read this stuff in parallel, in series, and check out other sources. Above 
all, practice problems. The file "Syllabus" is a words based syllabus for the mathematician and physicist, 
and a recounting of the origin of some of the main limitations of mathematics and physics. 
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Part I . Chapter 1. (Accessible to sophomores; required for mathematics/physics majors up through the 
postdoctoral research level) We begin with an example. 

Example 1.1 — The symmetry of an ordinary differential equation (ODE). The general solution of 

^l= 2 -l (1) 
dx x 

is y = cx 2 . We restrict our attention to x > 0,y > 0, in which each solution curve corresponds to a 
particular c > 0. The set of solution curves is mapped to itself by the discrete symmetry 



(x,y) = (^-). (2) 
If we pick one particular solution curve of (1), say c = c x , then 



<x \\ / x 1 
\y'y) \c 1 x 2 'c 1 x 2 / \c x x' c x x z 

Solving for x gives us x = l/O^x ). Then y = 1 / {c-^x 2 ) = c x 2 x. 2 / c x = c x x 2 . Symmetry (2) to the 



solution of ODE (1) is a "symmetry" because it leaves the form of the solution invariant in either the 
(x,y) coordinates or the (x,y) coordinates, like rotating a square by ninety degrees on the plane leaves 
the square invariant. The symmetry is a smooth (differentiable to all orders) invertible transformation 
mapping solutions of the ODE to solutions of the ODE. Invertible means the Jacobian is nonzero: 

*x9y ~ x y9x * 0- (4) 
Another way to express the transformation is using a matrix: 

y V 1/y 2 / V l/(_c}x'y 
Since we restricted ourselves to x > 0,y > 0, it must be that c > 0. The inverse of the matrix is 

(c x 2 \ 
1 _ ), and it is also smooth. In these notes, if x is any point of the object (a point on a solution 
yv 
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curve of the ODE in our case), and if T: x >— » x(x) is a symmetry, then we assume x to be infinitely 
differentiable wrt x. Since T -1 is also a symmetry, then x is infinitely differentiable wrt x. Thus T is a 
(C°°) diffeomorphism (a smooth invertible mapping whose inverse is also smooth). Is the connection 
between symmetry (an algebraic concept) and a differential equation deep or merely superficial? 

Example 1.2 — (More evidence tying symmetries to differential equations) Consider the Riccati equation 

2y 1 

y' = xy 2 — — — — = a)(x,y), x 0. (6) 

Let's consider a one-parameter symmetry more focused on the ODE than its solution. Let (x,y) = 
(e £ x, e~ 2E y). Then (x,y) = (e _£ x, e 2£ y). Substituting into (6) to get 



d y 3s d y 3e~~2 3e 2 y 3£ 1 ~ + n m 

ax ax x x 6 



9 2 y 1 (8) 
f = X y 2 x * 0. v ' 

X X J 

How did we cook up this symmetry? By taking a guess, an ansatz. A more satisfying answer lays ahead. 

If we set e to zero, the symmetry is the identity symmetry. As we vary the parameter e we trace 
a curve in the xy — plane. At any given (x, y) the tangent to the curve parameterized by e is 

((£L'© e J =(f(i ' 5,) '" fcy))=fc - 2y) - 191 

If we suppose that the tangent to the curve parameterized by e is parallel to y' , then we are supposing 
that 

, ri(x,y) (10) 

y =77 r = &>(x,y). 

f(x,y) 

Then, 

r]{x,y) - &>(x,y)£(x,y) = 0. (11) 
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Equivalently, 

n ( 2 2 y 1 \ 1 2 2 n (12) 

This is true if y = + l/x 2 . So we have found some solutions! Let's check if y = — 1/x 2 is a solution. 

dy 2 2 2ylxxl2 (13) 
dx x 3 X ^ x x 3 x 4 x 4 x 3 x 3 ' 

It seems that if we can find a symmetry to a differential equation we might find some solutions. This 
was the great observation of Sophus Lie. There are other solutions. 

Let's build some tools. We restrict ourselves to first order ODEs. Soon afterwards we shall 
build tools for higher order ODEs and partial differential equations (PDEs), either linear or nonlinear 
ODEs or PDEs. Consider the first order differential equation 

dy (14) 
- = *>(*, y). 

We assume there is a diffeomorphism T: (x, y) i— » (x, y) that is also a symmetry of ODE (14). That is we 
assume that 

dy _ _ dy (15) 

— = OL>(x,y) when — = a)(x, y). 
dx dx 

Equation (15) is called the "symmetry condition" for ODE (14). The symmetry condition is a symmetry 
transformation (like the one in example 1.2) which leaves the differential equation invariant despite the 
smooth change of coordinates to (x, y). 

Does T exist? I don't know. The point is to assume at least one such symmetry exists that is a 
diffeomorphism connecting (x,y) coordinates to (x,y) coordinates, i.e., x = x(x, y) and y = y(x,y), 
and to study the properties that such symmetry must have as a consequence of our smoothness 
stipulations. 
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Relating dy/ dx to the original coordinates (x, y) is the total derivative D x = d x + y'd y + 
y"d y i + ■■■ . In this notation, subscript Latin letters imply differentiation wrt that Latin letter, e.g., 
% = dy/d y. Keeping only terms up to first order 

D x y = 9x + y'% (i6) 

D x x x x + y Xy 
The symmetry condition (15) for ODE (14) yields 

D x y y x + y'% _ „ , dy (17) 

— — — = — — = cl>{x, y) when — = a)(x, y). 

D x x x x + y'x y y yj dx y yj 

Since y ' = u>(x, y) in the original coordinates, and we may write 

y x + w(x,y)y y (18) 

■—- — — = (o(x,y). 

x x + CL>(x,y)Xy 

Equation (18) together with the requirement that T is a diffeomorphism is equivalent to the symmetry 
condition (15). Equations (17) or (18) tie (or "ligate") the original coordinates (x,y) to the new 
coordinates (x(x, y), y (x, y)). This result is important because it may lead us to some if not all of the 
symmetries of an ODE. Was the symmetry to the Riccati equation pulled from the ass of some genius, 
or was there a method to the madness? (Notice the Riccati equation is nonlinear.) 

Example 1.3 — To better understand the hunt for symmetries, consider the simple ODE 

dy_ (19) 
dx _y ' 

Symmetry condition (17) implies that each symmetry of (19) satisfies the PDE 

y x + y'% 



„ = y. 

Since y ' = y in the original (x, y)coordinates, equation (18) equivalently implies that 
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y x + y% . (20) 

— = y. 

X x + yXy 

Rather than trying to find the general solution to this PDE, let us instead use (20) to inspire some simple 
guesses at some possible symmetries to ODE (19). Say we try (x, y) = (x(x, y), y). That is y is only a 
function of y, and not of x, i.e., y = y. Then y x = 0, y y = 1, and (20) reduces to 

y -,. (2D 



or, 

x x +y'x y = l, (22) 
For any symmetries which are diffeomorphisms, the Jacobian is nonzero. That is, 

X-xVy XyVx X-x ' 1 %y ' ^ ^x ^ (23) 

The simplest case of x x =t is x = x + s. So the simplest one-parameter symmetry to ODE (19) is 

(x,y) = (x + £,y). (24) 
Let's check by substituting this into the LHS and RHS of (17). 

(9x + y'9 y + y'-l ,) (25) 

k^y=^T^=n LHS = {y = y] ^ 

The diffeomorphism (x,y) = (x + s,y) is therefore a symmetry of ODE (19). We now have some hope 
that producing the symmetry to the Riccati equation may have more to it than a genius' guess. There 
are more powerful, more systematic methods to come. 

WARNING!!! Eleven double spaced pages with figures and examples follow before we treat the 
Riccati equation with a more complete set of tools (feel free to peek at example 1.8). Most of the 
material is fairly transparent on first reading, but some of it will require looking ahead to the fuller 
Riccati example (example 1.8), going back and forth through these notes. 



Let's collect a lot of equivalent verbiage and nomenclature. In example 1.3, symmetry (24) to 
ODE (19) is called a one-parameter symmetry because it (a) leaves the form of the given ODE invariant in 
either the original coordinates (x, y), or in the new coordinates (x, y), just as rotating a square by ninety 
degrees on the plane leaves it invariant, and because (b) the symmetry depends smoothly on one real 
number parameter, s. Symmetry (24) is a smooth mapping (diffeomorphism). Its Jacobian is nonzero. 

Symmetry (24) may also be expressed in matrix form as 



Matrix (26) is invertible. I'm telling you this matrix stuff because we shall eventually see that there is 
practical value to studying the abstract (group theoretic) algebraic properties of the matrix 
"representations" of the symmetries of a differential equation, as well as to studying the topological 
properties of such symmetries, like their continuity and compactness. Abstract algebra, topology, and 
algebraic topology aren't vacuous constructs built for useless mental masturbation by "pure" 
mathematicians; the study of differential equations is more than a study of botany. Anytime during 
these eleven pages that you feel discouraged, please peek ahead to example 1.8 to see that it's worth it. 

In example 1.1, we found one symmetry to ODE (1), namely symmetry (2). ODE (1) has another 
symmetry, namely, 



Check by substitution that (27) is a one-parameter symmetry of ODE (1). So there can be more than one 
symmetry. 

The solution curve y = c x x 2 gets mapped to (x, y) = (e £ x, c 1 e _£ x 2 ). Solving for x, we obtain 
x = e~ £ x, and therefore y = c 1 e _3£ x 2 = c 2 x 2 , the same form as in (x,y) coordinates. We can see 




(26) 



(x,y) = (e £ x,e £ y). 



(27) 
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that the xy-plane and the xy-plane contain the same set of solution curves. 



xy-plane 



xy-plane 





There is another point of view. Instead of a transformation from one plane to another, we can also 
imagine that the symmetry "acts" on a solution curve in the xy-plane as depicted in the following figure. 



In the latter point of view, the symmetry is regarded as a mapping of the xy-plane to itself, called the 
action of the symmetry on the xy-plane. Specifically, the point with the coordinates (x, y) is mapped to 
the point whose coordinates are (x, y) = (x(x, y), y(x, y)). The solution curve y = f(x) is the set of 

points with coordinates(x,/(x)). The solution curve is mapped to (x,/(x)) by the symmetry, e.g., 

(x, CjX 2 ) i-> (x, c 2 x 2 ). The solution curve is invariant under the symmetry if / = /. A symmetry is 
trivial if it leaves every solution curve invariant. Symmetry (2) to ODE (1) is trivial. Go back and see for 
yourself. Symmetry (27) to ODE (1) is not trivial. 



xy-plane 
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A one-parameter symmetry depends on only one-parameter, e.g., s. A one-parameter 
symmetry may look like (x,y) = (e £ x, e _£ y) or like (x,y) = (x + e,y + s). A two-parameter 
symmetry may look like (x + e lt y + s 2 ). We restrict ourselves to one-parameter symmetries until 
further notice. 

Group theory basics. It is time to note that our one-parameter symmetries are groups in the 
sense of modern algebra. Why? To masturbate with nomenclature as you do in an abstract algebra 
class? No. Because, as you will soon see, studying the group structure of a symmetry of a differential 
equation will have direct relevance to reducing its order to lower order, and will have direct relevance to 
finding some, possibly all of the solutions to the given differential equation— ordinary, partial, linear, or 
nonlinear. So what is a group? 

A group is a set G together with a binary operation * such that 

(I) There is an element of G, called the identity (e), such that if g £ G, the e*g = g*e = g. (Identity) 

From ODE (1) with symmetry (x, y) = (e £ x, e _£ y), we see that (x, y) = (e £ x, e _£ y) = (x, y) when 
e = 0. The identity element doesn't do jack. It has no action. 

(II) For every (V) a £ G there exists (3) a a -1 £ G such that (3) a * a -1 = a -1 * a = e. (Inverse) 

The inverse to the symmetry for ODE (1) (x, y) = (e £ x, e _£ y) is (e _£ x, e £ y). Actually, these two 
symmetries are their own inverses. The first symmetry "moves" (x,y) to (e £ x, e _£ y). Applying the 
inverse moves you back to (e £_£ x, e _£+£ y) = (x,y). In the symmetry we are using, you could reverse 
the order and get the same result, but this is not always the case. Not everything is commutative 
(Abelian). Cross products of three dimensional Cartesian vectors, for example, are not commutative 
(non Abelian). A x B B x A. (Titration: Noncommutativity underlies quantum physics. You will see 
this before you finish this set of notes.) 
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(III) If a, b £ G, then a*b£G. (Closure) 

If a denotes (e £l x, e _£l y) and b denotes (e £2 x, e _£2 y), then a* b denotes (e £l+£2 x, e _£l_£2 y), which 
is a member of G. Note that since e x , the group G is a continuous group. 

(IV) If a, b, c £ G, then a * (b * c) = (a * b) * c £ G. (Associativity) 

Check this yourself as we checked property (III). Lastly note that since the parameters are continuous, 
the groups are continuous groups. Lots of diverse mathematical structures are groups. 

Example 1.4 — The set of even integers together with addition being * is a discrete group. Check the 
definition. 

Example 1.5 — The set of polynomials together with the rules of polynomial addition being * is a group. 

Example 1.6 — The set of 2 x 2matrices that are invertible (have inverses) form a group with matrix 
multiplication being *. The identity is the 2x2 matrix with ones in the diagonal and zeros otherwise. 



that are not commutative— this stuff underlies quantum physics.) 

The symmetry (27) to ODE (1) is, moreover, an infinite one-parameter group because the 
parameter £ is a real number on the real number line. In example 1.3, we met an infinite set of 
continuously connected symmetries, namely, (x,y) = (x + s,y). This symmetry smoothly maps the 
plane R 2 to the plane R 2 . Later on, with ODEs of higher than first order, we shall deal with symmetries 
from R 3 to R 3 , from R 4 to R 4 , and so on from R n to R n . These symmetries are called "Lie" groups 
after Sophus Lie, the dude who brought them to the fore to deal with differential equations. We deal 
with two more chunks of additional structure before getting back to practical, step-by-step applications 
to linear and nonlinear differential equations. 




. (Hint: In linear algebra we learn about matrices that 



are commutative, and matrices 
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Theorem I . Let us suppose that the symmetries of — = a)(x, y) include the Lie group of 
translations u>(x,y) = u>{x,y + s) for all e in some neighborhood of zero. Then, 

&)(x,y + e) — <w(x,y) = 0, 

therefore when e so does 

co{x,y + g) - faj(x,y) 

and therefore 

w(x,y + e) - &>(x,y) 
hm = a) v (x, y) = 0. 

£^0 £ y 

Thus the function on only depends on x. Thus ^ = <y(x), and y = J <y(x)dx + c. The particular 

solution corresponding to c = is mapped by the translation symmetry to y = J oj(x)dx + e = 
J u)(x)dx + s, which is the solution corresponding to c = e. Note— A differential equation is 
considered solved if it has been reduced to quadrature— all that remains, that is, is to evaluate an 
integral. Also note that this theorem will be deeply tied to the use of canonical coordinates up ahead. 

Action. It is useful to study the action of one-parameter symmetries on points of the plane. The 
orbit of a one-parameter Lie group through (x, y) is a set of points to which (x, y) can be mapped by a 
specific choice of e, 

(x, y) = (x(x, y; e), y(x, y; e)). (28) 

with initial condition 

(x(x, y; 0), y(x, y; 0)) = (x, y). (29) 
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The orbit through a point may be smooth as in the figure above, but there may be one or more invariant 
points. An invariant point is a point that gets mapped to itself by any Lie symmetry. An invariant point 
is a zero-dimensional orbit of the Lie group. In symmetry (24) the origin is mapped to the origin. The 
origin is an invariant point. Orbits themselves are closed. That is, the action of a Lie group maps each 
point on an orbit to a point on the orbit. Orbits are invariant under the action of a Lie group. 

The arrow in the figure above depicts the tangent vector at (x, y). The tangent vector to the 
orbit at (x, y) is (x, y), r/(x, y)), where 



— = J?(x,y). 



The tangent vector at (x, y)is (<f (x, y), r\{x, y)) 




(31) 



Therefore to first order in s, 



x = x + £^(x, y) + 0(£ 2 ), 



(32) 



y = y + £t](x,y) + 0(s 2 ). 



(33) 



The set of tangent vectors is a smooth vector field. In example 1.3 with symmetry (24) we get 
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Plugging the above into equations (32) and (33) we get x = x + s and y = y, which is symmetry (24). I 
was just checking that all of this stuff is consistent. Note that an invariant point is mapped to itself by 
every Lie symmetry. Thus for an invariant point, we have ^(x,y) = rj(x,y) = from (32) and (33). It's 
alright if this stuff doesn't yet mean much. It will soon allow us to find, if possible, a change of 
coordinates that may allow a given differential equation to be reduced to a simpler form. The first 
application will be to finding more solutions to the Riccati equation in "canonical" coordinates. 

Characteristic equation. This next block of structure follows directly from example 1.2. See the 
paragraph containing equations (9) through (12) in example 1.2. Any curve C is an invariant curve 
7 = f(x) if and only if (iff) the tangent to C at each (x, y) is parallel to the tangent vector 
( x > y)> Vi x > y))- This i s expressed by the characteristic equation 

Q(.x,y,y') = -n(x,y)-y'Z(x,y). (34) 
Cis parallel to (s, rj) iff Q(x,y,y') = 0. on C, or 

, = V(.x,y) (35) 

y ttx.y)' 

This implies that 

dy (36) 

Tx = <x,y) 

can have its invariant solution characterized by 

Q(x,y,a)(x,y)) = r){x,y) - y'^(x,y). (37) 
Equation (37) is the reduced characteristic. 

The new shorthand applied to the Riccati equation in example 1.2 updates that example to the 
following. We were given y' = xy 2 ~~~~i = <^(.x,y), x 0. The ansatz was (x,y) = 
(e e x, e~ 2€ y). The tangent vector is (x,y) = (x, — 2y). The reduced characteristic is Q(x,y) = 
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r){x,y) -y'f(x,y) = -2y - (xy 2 - ^ - ^) = ^-x 2 y 2 . Q{x,y) = iffy = f{x) = the 

"invariant solutions". Most symmetry methods use the tangent vectors rather than the symmetries 
themselves to seek out "better" coordinates to find solutions to differential equations. 

Canonical coordinates. We use canonical coordinates when the ODE has Lie symmetries 
equivalent to a translation. Symmetry (24) gives us an example of a symmetry to an ODE which is a 
translation (x, y) = (x, y + s). The ODE is greatly simplified under a change of coordinates to canonical 

coordinates, e.g., the Riccati equation y ' = xy 2 — — — \ = gl>(x, y), x turns to ^ = 

Given (x, y) = (x, y + e) with tangent vector {e(x, y), r](x, y)) = (0,1), we seek coordinates 
(r, s) = (r(x, y), s(x, y)) such that (f, s) = (r,s + s). Then the tangent vector is ((^) = 

0, f — ) = l). Using — = f(x,y), — = ??(x,y), and the chain rule 

\de/ p= c / de de 



dr dx dr dy (38) 

1 — — 0, 

dx d£ dy d£ 

ds dx ds dy (39) 
dx d£ dy d£ 



we get 



£ (x, y)r x + r] (x, y)r y = 0, (40) 
^(x,y)s x + ?7(x,y)s y = 1. (41) 
By smoothness the Jacobian is not zero. That is, 

r x s y — r y s x 0. (42) 
Therefore a curve of constant r and a curve of constant 5 cross transversely. Any pair of functions 
r(x,y),s(x,y) satisfying (40) through (42) is called a pair of canonical coordinates. The curve of 
constant r corresponds (locally) with the orbit through the point (x, y). The orbit is invariant under the 
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Lie group, so r is the invariant canonical coordinate. Note that canonical coordinates cannot be defined 
at an invariant point because the determining equation for s, namely Z(x,y)s x + rj(x,y)s y = 1, has no 
solution if ^ = r\ = 0, but it is always possible to normalize the tangent vectors (at least locally). Also 
note that canonical coordinates defined by (40) and (41) are not unique. If (r, s) satisfy (40) and (41) so 
do (f, s) = (F(r), s + G(r)). (Thus, without proof there is a degeneracy condition which states 
F'(r) 0, but there is still plenty of freedom left.) 

Canonical coordinates can be obtained from (40) and (41) through the method of 
characteristics. In the theory of ODEs, the characteristic equation is 

dx dy (43) 

= ds. 



e(x,y) rj(x,y) 

This is a system of ODEs. Here follows a definition. A first integral of a given first-order ODE 

d y f( . (44) 

dx" = /(x ' y) 

is a nonconstant function <p(x, y) whose value is constant on any solution y = y(x) of the ODE. 
Therefore on any solution curve y = y(x), 

dip dip dipdy (45) 
dx dx dy dx 

d<P d<f> d(f> (46) 

^ = ^ + /(*,y)^ = o, y *o. 

The general solution is 0(x,y) = c. Suppose that ^(x,y) ^ in equation (40). Then let's rearrange 
equation (40) as 

?7(x,y) (47) 
r x + J^y] r y = r * + f( x -y>y = °- 

Comparing (46) with (40), we see that the r is a first integral of 
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dy _rj(x,y) (48) 
dx £(x,y)' 

So r = 0(x, y) is found by solving (48). It is an invariant canonical coordinate. Sometimes we can 
determine a solution s(x, y) by inspection, else we can use r = r(x, y) to write y as a function of r and 
x. The coordinate s(r, x) is obtained from (43) by quadrature: 



*r *)-(( ^ ) 

\J s(x,y(r,x))) r=r(xy) ' 



(49) 



where r is being treated as a constant. 

If s(x, y) = and rj(x, y) then the canonical coordinates are 



r = x, s(r 



\J r](r,y)J r=x 



(50) 



Example 1.7 — Every ODE of the form y ' = F(y/x) admits the one-parameter Lie group of scalings 
(x, y) = (e £ x, e £ y). Consider ^ = ^ as a very simple example (of course we know y = cx k is the 



solution). Ifx^O, the canonical coordinate r is r = yx k = constant. Then s(x,y) = J— = ln|x|. 
Thus (r, s) = (yx _k ,ln|x|). At x = we need a "new coordinate patch": r = y~ 1 x k , s = -ln|y|. So 
what? Finding canonical coordinates reduces ugly ODEs into simpler ODEs. We're steps away from this. 

Recall that Lie symmetries of an ODE are nontrivial iff 

j?(x,y) * w(x,yX(x,y). (51) 
If ODE (14), ^ = (jL>(x,y), has nontrivial Lie symmetries equivalent to a translation, it can be reduced to 
quadrature by rewriting it in terms of canonical coordinates as follows. Let 

ds s x + a)(x,y)s y (52) 
dr r x + a)(x,y)ry' 
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The right hand side of (52) can be written as a function of r and 5 using the symmetry. For a general 
change of variables (x, y) >-> (r, s), the transformed ODE (52) would be of the form 

ds r (53) 
dr 

for some function fl. However, since we assume (r, s) are canonical coordinates, the ODE is invariant 
under the group of translations in the 5 direction: 

(r,s) = (r,s + e). (54) 

Thus from theorem I we know that 

O) s (r,s) = 0, (55) 

and therefore 

£ = QW (56) 

dr 

The ODE has been reduced to quadrature, and the general solution to ODE (56) is 

s(x,y) — j D.(r)dr = c. 
Therefore the general solution to ODE (14) is 



(57) 



r r ( x .y~) (58) 
s(x,y) — I fl(r)dr = c. 

This is great, but of course we must first determine the canonical coordinates by solving 

dy _ r}(x,y) (48) 
dx ^(x, y)' 

Example 1.8 — Let's finally compute the Riccati equation with both barrels using our updated toolset. 



2y 1 

y' = xy 2 5- = <y(x, y), x 0. (6) 

x x J 
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As we know, a symmetry of (6) is (x, y) = (e e x, e 2e y). The corresponding tangent vector is 
(s,rj) = (x, — 2y). The reduced characteristic Q{x,y, <y(x,y)) = ?7(x,y) — <y(x,y)^(x,y) is 

Q{x,y,(x){x,yj) = 2y - (xy 2 - — -\)x = \-x 2 y 2 . ^ 

Q{x,y, <y(x,y)) = iffy = We stopped here before. Now we use our symmetry's tangent vector 
to give us canonical coordinates to simplify the Riccati equation. Equation (48) becomes 



dy ??(x,y) 2y 
dx % (x, y) x ' 



(60) 



The solution is y = cons ^ ant - j nus r = y X 2 _ cons tant, and s(r, x) = ( f -. dx r -r ) 

* 2 \ J £(x,y(r,x))J r= r 



a — j = ln|x|. Thus our canonical coordinates are 



(r, 5) = (yx 2 ,ln|x|). 



(61) 



Of course x = e s and y = e 2s r. So r x = 2xy; r y = x 2 ; s x = -; s y = 0. Plug into equation (52): 



ds s x + a)(x,y)s y 



1 

x 



1 

X 



(62) 



dr r x + a)(x, y)r y 2xy - a>(x, y)x 2 2xy _ x3y2 _ 2x y - - x4 ^ 2 _ 1 r2 ~~ 1 
The Riccati equation has been reduced to quadrature in the canonical coordinates. That is 



Converting back to the original coordinates we get 



1 r- 1 

2,, 2 r + 1 



(63) 



ln|x| - -In 



x 2 y — 1 



x 2 y + 1 



= ln|x| +ln 



x 2 y — 1 



x 2 y + 1 



= In 



x 2 y — 1 



x 2 y + 1 



= c . 



x 2 y — 1 
x 2 y + 1 



x 2 = e c ° = 



(64) 



(65) 
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x 4 y — x 2 = cx 2 y + c. (66) 

(x 4 — cx 2 )y = c + x 2 . (67) 

c + x 2 (68) 
^ x 2 (x 2 — c)' 

We have solved the Riccati equation. We can get back the two solutions that were derived using the 

i i 

reduced characteristic equation by taking limits: lim^^ y = — and lim c ^ y = — —. Note for sticklers, 

the "Riccati" equation is actually any ODE that is quadratic in the unknown function. It is nonlinear. We 
can solve it! Our method is general. Screw botany. Another note: looking at patterns that are invariant 
to symmetry (x,y) = {e e x, e~ 2e y), I noticed that what we did would work for the Riccati equation with 
the following extra terms: 

y' = Riccati equation + x 3 y 3 , 
y' = Riccati equation + x 3 y 3 + x 7 y 5 , 
and so on. For the latter equation with the two extra terms we get, for example, 



1 

ds x 



dr 2xy co ■ x 2 2 y - x 2 y 2 - 2y - ^ + x 4 y 3 + x 8 y 5 -x 2 y 2 - ^ + x 4 y 3 + x 8 y 5 



Since x = e s and y = rx 2 = e 2s r, we get 



ds v 2 e 



-2S 



dr _ v2r 2 v -4 _ J_ , v 4 r 3 v -e , v s r 5 v io s 2s r 2 - e 2s + e 2s r 3 + e 2s r s 



-x z r z x 4 — — + x*r i x b + x a r b x J 

1 



2 j ^ y 3 y 5 ^ y 5 j 3 y 2 ^ 



Linearized symmetry condition. So here is what we have so far. One method to find 

civ 

symmetries of — = a)(x,y) is to use the symmetry condition (constraint) 
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% + a)(x,y)y y (18) 

■—- — — = (o(x,y), 

x x + CL>(x,y)Xy 

which is usually a complicated PDE in both x and y. By definition, Lie symmetries are of the form 

x = x + £^(x,y) + 0(£ 2 ), (32) 
y = y + £T](x,y) + 0(e 2 ), (33) 
where f(x,y) and rj(x,y) are smooth. Note that to first order in s, y x = + srj x , y y = 1 + srj y , x x 
1 + ee x , x y = + £^ y So when we substitute (32) and (33) into LHS of (18) we get: 

fa (y + £r]{x, y)) + a)(x, y) ^ (y + sr](x, y)) ^ 68 ^ 
q£ (x + (x, y)) + &)(x, y) ^ (x + e£ (x, y)) 

_ £Vx + faj(x,y)(l + £7? y ) 
1 + £^ x + £a)(x,y)f y 

1 

Recall that « 1 — £x when £x is small. Applying this binomial approximation to (68), we get 

(68) = (erj x + a)(x,y) + &>(x,y)£?7 y )(l - £^ x + £a>(x,yX y ) 
= £?? x + &>(x,y) + a)(x,y)sr]y - e 2 r] x ^ x - e^ x (o(x,y) + s 2 r]y^ y a) 2 (x,y) + s 2 r] x ^ y a)(x,y) 
+ eo) 2 (x,y)% y + s 2 T]y^ y a) 2 (x,y), 

and dropping terms higher than first order in s as negligible we get 

= sr] x + Go(x,y) + (jo{x,y)sr]y - s^ x co{x,y) + £a) 2 (x,y)f y . 
Substituting (32) and (33) into the RHS)of (18) we get: 

a)(x,y) = <y(x + e%,y + erf) = a)(x,y) + s^a) x (x,y) + Er\u> y {x,y). 
Putting the LHS together with the RHS we get: 

sr] x + a)(x,y) + (ji)(x,y)sr]y - e^ x u>{x,y) + eoy 2 {x,y)^ y = <y(x,y) + s^a) x (x,y) + Er\u> y {x,y). 



Canceling things out and getting rid of s, we get: 

rj x + o)(x,y)rj y - % x ai(x,y) + a) 2 (x,y)^ y = <fa> x (x,y) + rja) y (x,y). (69) 
Finally rearranging, we get the linearized symmetry condition 

+ (v y ~ $x)te{x,y) ~ M 2 {x,y)$y = ^ x (x,y) + rja)y(x,y). (70) 
The linearized symmetry condition is a single PDE in two independent variables with infinitely many 
solutions, but it is linear and simpler that the original, nonlinearized PDE. 

Example 1.9 — Let's do it! Consider, 

dy 1-y 2 (71) 
-f= — +1. 

ax xy 

From experience with these symmetry techniques, beginning with simpler differential equations and 
progressing onwards (much like Feynman did with his Feynman diagrams), our ansatz shall be: 

£ = a(x), fj = (3(x)y + y{x). (72) 
We plug our ansatz into the linearized symmetry condition to get 

fy + y' M + W-C) {^f + l) = a (^) - (Py + y) i^f). (?3) 

Let's split (73) into a system of over determined equations by matching powers of y. On the LHS of (73) 
there are no terms with y~ 2 . On the RHS there is a term y/xy 2 . Then y = 0. So (73) reduces to: 

Matching LHS terms with y~ 2 to RHS with y~ 2 leads to 

(ft-a') = a /3 (75) 

X X 2 X 
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Finally, matching LHS terms to RHS terms with y° leads to (/? — a') = 0, so /? = a'. Then the LHS of 
(75) equals zero. Equation (75) reduces to 

a a' (76) 
= —--. 

x z x 

So a' + ^ = 0. Solving the simple ODE leads to a = CjX -1 . This in turn tells us /? = c-yX~ 2 . Thus, finally, 

we have ^"(x) = CjX -1 , and rj(x,y) = c x x~ 2 y. We have our tangent vector. So far to me it does not 
appear that this symmetry came from a translation symmetry, so I have not found canonical 
coordinates. However the reduced characteristic does lead to solutions. Recall that Q{x,y,u>{x,y')) = 
r](x,y) — a)(x,y)^(x,y). Substituting u>{x,y), ^"(x), and J?(x,y), we get 

y (1-y 2 _ \ci < 77 > 



Q( X ,y Mx , y) ) = - Cl --\—— +1 j- 



a 2 ( , 1 , 



X 2 



y H (1 — y + xy) 



If we set Q to zero we get: 

y + - ■ (1 - y 2 + xy) = 0. (78) 

y 

This is so if y = — -. We check this by substituting the solution into both the RHS and LHS of (71) to get 

_ lzz! + i - Ilk i 1 - 1 - d - dl 



-^1+1 = — = — y = 

-1 x 2 dx^ dxx 



Let's write the reduced characteristic in terms of the linearized symmetry condition as follows: 

Q=rj-(ot;. (79) 



Let 



Q x + o>Q y = u y Q. (80) 
Now let's take the appropriate partial derivatives of (79). 
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Vx - d>x^ ~ <x>Sx + ^(jly ~ <*>y% ~ 0)%y) = (Oyb] - 0)0- 



(81) 



r\ x — a) x ^ — a)^ x + o)T] y — u>u> y ^ — U) 2 ^ y = (x> y r\ — u> y u>^. 



(82) 



Ix - OixS - ^x + <M\y -0> 2 $y = Myl- 



(83) 



Rearranging leads to the linearized symmetry condition: 



Vx + (Vy ~ $x)<» ~ fy w2 = $0) x +VO)y 



(70) 



If Q satisfies (79), then rf) = , Q + out; ) is a tangent vector field of a one-parameter group. All Lie 
symmetries correspond to the solution Q = 0. Nontrivial symmetries can be found from (80) using the 
method of characteristics 



The LHS is, uselessly, our original ODE. Lastly note that if rj) is a nonzero solution to the linearized 
symmetry condition, then so is (k^, krj) V k > 0. This freedom corresponds to replacing s by k _1 s, 
which does not alter the orbits of the Lie group. So the same Lie symmetries are recovered, irrespective 
of the value of k. The freedom to rescale e allows us to multiply Q by any nonzero constant without 
altering the orbits. 

On patterns— We may take derivatives by always applying the formal definition of a derivative, 
e.g., -7-x 2 = lim Ax ^ ( - x+A *' ) — — = 2x, but if we take enough derivatives we begin to discover patterns 
such as the power rule, the quotient rule, or the chain rule. The same applies to using symmetry 
methods to extract solutions to differential equations. Some common symmetries, including 
translations, scalings and rotations can be found with the ansatz 



dx dy dQ 



1 (o(x,y) (o{x,y)Q 



% = c x x + c x y + c 3i r\ = c 4 x + c 5 y + c 6 



(84) 



This ansatz is more restrictive than ansatz (72). Ansatz (84) works for 
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y — 4xy — 16x 2 
y 3 + 4x 2 y + x 

if c-i = c 3 = c 5 = c 6 = 0, c 4 = — 4c 2 . Specialized computer algebra packages have been created to 
assist with symmetry methods for differential equations. For first order ODEs the search for a nontrivial 
symmetry may be fruitless even though the ODE might have infinitely many symmetries. Symmetries of 
higher order ODEs and PDEs can usually be found systematically. The following link from MapleSoft is a 
tool for finding symmetries for differential equations (July 2012: 
http://www.maplesoft.com/support/help/Maple/view.aspx?path=DEtools/svmgen 

Please refer to chapter two of the Hydon textbook for many comparisons and relationships between 
symmetry methods and standard methods. 

Infinitesimal generator. Suppose a first order ODE has a one-parameter Lie group of 
symmetries whose tangent vector at (x, y) is (s, n). Then the partial differential operator 

X = ax,y)d x + r](x,y)d y (85) 
Is the infinitesimal generator of the Lie group. We have already encountered and used such infinitesimal 
generators. Recall 

f (x, y)r x + n (x, y)r y = 0, (40) 
${x,y)s x + n(x,y)s y = 1. (41) 

We may rewrite them as 

X r = 0, (86) 
X s = 1. (87) 
We shall soon see that the algebraic properties of the infinitesimal generators of a differential equation 
(under commutation) will tell us if we can reduce the order of the differential equation by one or more. 
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In the following examples let's suppose that we have a symmetry of some differential equation. From 
this symmetry we compute the corresponding infinitesimal generator. 

Example 1.10 — For the Riccati equation, one symmetry is (x,y) = (e £ x, e _2£ y). Then, ^(x,y) = 
O £=0 = ^ e£x ^=o = x and Vfr, y) = (^) = (-2e~ 2£ y) £=0 = -2y . Therefore X = xd x - 2yd y . 
The canonical coordinates were (r, s) = (yx 2 , ln|x|). 

Example 1.11 — The differential equation — = — — + — has Lie symmetries of the form (x, y) = 
The tangent vector is given by (x 2 ,xy). Therefore X = x 2 d x + xyd y . 

Example 1.12 — Given (x,y) = (x + s,y + s), ^(x,y) = (-^) = 1 and jy(x,y) = (-^) = 1 . 

\£l£/ £= o Va£/ £= o 

Therefore X = d x + d y . 

Optional— 6 Page Double Spaced "BIG PICTURE" Motivational digression Example with Discussion 

Example 1.13 — Let's peer ahead into the extreme importance of understanding the key algebraic 
properties of the infinitesimal generators of a differential equation to mathematicians and physicists. 
Don't worry. We will build soon build the math in detail. Consider the following fourth order ODE 

y m = y »,\ (88) 

By applying the linearized symmetry condition for n th order ODEs (see chapter 2) we get the following 
set of infinitesimal generators associated with ODE (88): X x = dy, X 2 = xdy, X 3 = x 2 dy, X 4 = dx, 
X 5 = xdx. The commutators of these infinitesimal generators are defined by: 

[X i ,Xj]=X i Xj-X J X i . (89) 
If i = j the commutator is zero. Some other commutators with i j are zero. Some are not zero, e.g., 
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[X lt X 2 ] = X{X 2 - X 2 X 1 = dy(xdy) - xdy{dy) = x - x = 0, (90) 
[X 2 ,X 4 ] = X 2 X 4 - X 4 X 2 = xdy{dx) - dx{xdy) = - dy = -X v (91) 
If you try all the remaining possible pairs of commutators, the only other nonzero commutators are 

[^2*^5] = — %2> [^3^4] = — 2Z 2 , [Z 3 ,Z 5 ] = — 2X 3 , [X 4 ,X$\ = X 4 . 

ODE (88) has a five-dimensional Lie algebra £ = {^,^2,^3,^4,^5}. Note that from all possible 
commutators taken from the set {X^,X 2 , X 3 ,X 4 ,X 5 } we only get back the infinitesimal generators 
{X 1 ,X 2 ,X 3 ,X 4 }. There is no = c ■ X 5 where c is nonzero. We say that the infinitesimal 

generators {X 1 ,X 2 ,X 3 ,X 4 ,X 5 } form a derived subalgebra = span^,^,^,^) under the (binary) 
operation of commutation. Now by taking all possible commutators from the set {X 1 ,X 2 ,X 3 ,X 4 } you 
only get back two infinitesimal generators, namely, £® = span^, X 2 }. Repeating this using all 
possible commutators from {X 1 , X 2 ], you get £® = {0}. 

Let's sum up. Beginning with {X 1 ,X 2 ,X 3 ,X 4 ,X S }, we built a "solvable tower" down to 
span{X 1 ,X 2 ,X 3 ,X 4 .}, down to span^,^}* ar| d finally down to span{0} under commutation. When this 
is possible, which isn't always, the subalgebra is said to be solvable. This is important. An n th order ODE 
with R < n Lie point symmetries can be reduced in order by n — R, becoming an algebraic equation if 
n = R. If the ODE is of order R with an i?-dimensional solvable Lie algebra, we can integrate the ODE in 
terms of differential invariants stepwise R times After taking tons of undergraduate and graduate 
algebra I knew of no good reason as to why I should care about solvability. My experience was not 
unique. Most PhD mathematicians have never learned the useful nature of solvability for differential 
equations, including the algebraists among them. Whatever it is they do know, it is incomplete and 
lacking defining context. A terrible consequence of this is that PhD physicists, who go through school 
eating and breathing differential equations only learn to "ape" seemingly disparate algebraic methods, 
coming out ignorant of very powerful and unifying symmetry methods, necessarily suffering the 



consequences of having a confused, disconnected collection of magical mathematical prescriptions, 
namely suffering a needless weakening of their fundamental understanding of physics. Most of us are 
not keen to waste time with useless mental masturbation and dissipation. To the greatest extent 
possible, people do not go into physics to practice witchcraft in terms of magical mathematical 
prescriptions. Let mathematics be well taught. Let mystery come from nature. By the end of Part I you 
will operate with the algebraic properties of infinitesimal generators and their commutation 
relationships to treat differential equations the way you might sum sports figures. 

Let's now direct this digression to the physical importance of infinitesimal generators and their 
commutation algebra. When you study quantum physics you learn rules for converting classical physics 
equations into their quantum mechanical counterparts. We assign classical physics energy to a 

differential operator: E i— > ih^. Sticking to just one space dimension, we assign the classical physics 

momentum to a differential operator: p x *—* —ih-^. Position x and time t remain unaffected when 

they are transformed to operators: x ■— » x, t ■— » t. Quantum mechanical operators operate on wave 
functions xfj(x, t). Let's show this with a simple, one-dimensional, classical physics spring-mass system. 

The total energy of a mass m oscillating at the end of a spring with spring constant k is E = ^mv 2 + 
\kx 2 = y~ + \kx 2 . Converting this equation into a quantum mechanical equation leads to the 
Schrbdinger equation for the quantum mechanical oscillator ih^- \p(x,t) = \—(ih-^A + 



-kx 2 

2 



x/j(x, t) = ^^zV'C^'O + ~kx 2 ip(x, t), a crude model of an electron vibrating to and from a 



molecular or atomic nucleus giving rise to vibrational spectra. The commutator algebra of the 
differential operators we are using tells us what pairs of physical observables we can measure 
simultaneously with infinite precision, at least in principle, and what pairs of physical observables we 
cannot measure simultaneously with infinite precision no matter what we do. 
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Consider the commutator of the momentum and position operators, [— ift^xj \p(x, t). Using 
the chain rule, we have 



d 

-ih—,x 
ox 



ip(x, t) = —ih — {pj}{x, £)) — x {^^ a ~j *K X < 

d\p(x,i) d\p(x,i) 

= —ihip(x, t) — ihx — 1- ihx — = —ifup(x, t). 

ox ox 

Abusing notation, we write [ — ^^~> x ] = — This commutator is not zero. Position and momentum 
do not commute. As a consequence of this, the uncertainty principle applies to position and 

fl 

momentum. The uncertainty in position Ax and the uncertainty in momentum Ap obey AxAp > -. 

The more precisely we measure one of these observables, the more uncertainty shrouds the other 
observable. On the other hand, if the commutator had been zero, we could simultaneously measure 
position and momentum with infinite precession, at least in principle. This paragraph was never meant 
to replace a course in quantum physics, but to demonstrate the potential physical meaning of the 
derived commutator algebra of a physics-based differential equation. 

Sometimes the algebraic structure of the infinitesimal generators of a differential equation 
result in a discrete group under commutation. Such discrete groups can always be mimicked by 
matrices. In linear algebra you study, among other important things, how to compute the eigenvalues 
and eigenvectors of matrices. In physics, these eigenvalues can correspond to the particle spectra of the 
Standard Model of our universe, or to the particle spectra of some theoretical extension of the Standard 
Model, or even to the particle spectra of some hypothetical universe. In a nutshell, the process of 
studying (theoretical) universes begins with deriving the differential equations of motion (via the 
calculus of variations in terms of an "action principle" (Part II)). If the infinitesimal generators of a 
differential equation result in a discrete group either directly or from a higher subalgebra, we learn 
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how far the differential equation may be reduced in order; we learn which observables are subject to 
the uncertainty principle; there is, additionally, an associated matrix group that mimics the algebraic 
structure of the commutator relationships of the discrete group of infinitesimal generators of the 
differential equations. This group-theoretic matrix structure yields eigenvalues and eigenvectors that 
may correspond to the particle spectra of some universe (Part IV). 

Strangely, not everything is particle physics. If we're talking about electrons orbiting nuclei, 
eigenstates and eigenvectors are their energies and orbitals. Clearly what the eigenstates represent 
depends on what we are modeling. The Gell-Mann matrices (which mimic the discrete group structure 
of the commutator relationships of the infinitesimal generators of a differential equation derived from a 
variational action principle associated with a model of the strong nuclear force) are: 

/0 1 0\ /0 -i 0\ /l 0\ 

^=100, A 2 = [i , A 3 = -1 , 

Vo oo/ Vo o o/ Vo o o/ 

/0 1\ /0 -i\ /0 0\ 

A 4 = , h = , A 6 = 1 , 
Vl 0/ \i 0/ \0 1 0/ 

/ooo\ 1 /ioo\ 



A 7 = ( -i , A 8 = — 1 1. 
^0 i 0/ V3 Vo -2/ 

- jt 



These matrices are hermitian. That is they equal their complex conjugate transpose X i = A- and they 
are traceless (the sum of their diagonal elements equals 0). As usual, we define the commutators as 
[A a <Afc] = A a A b — A b A a . Here are a few nonzero cases: [A 1( A2] = 2iA 3 ^AJ = — 2iA 3 . In general, 

[Aj, A ; ] = -^ifijk,A k , where the repeated index implies summation, \A U Ay] = ^i{fij\,A x + fij 2 ,A 2 +... + 

/i;8-A 8 ). The only nonzero/^ are/ 123 = 1, / 458 = / 678 y, / 147 = f 165 = f 25 7 = /34s = /37s = 3- 
Any fij k involving a permutation of and k not on the list is zero. Even permutations, e.g., 
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123-^312-^213 have the same value. The odd permutations, e.g., 123-M32 have opposite sign. That 
is, /123 = /312 = /231 = 1, while /123 = /321 = /213 = -1- The symbol f ijk is said to be totally 

antisymmetric in and k. For example, [A 4 ,/l 8 ] = 2if 45a A a = lif^^A^ H 1- 2if 453 A 4 + — I- 

(1 \ 

2i/ 45 A = + + 2t ■ i/ 453 A 3 + + + + + 2i ■ y / 458 /l 8 = 2i . You may verify 

2 \0 -1/ 

this by checking A 4 A 8 — A 8 A 4 directly. Note that A 3 and A 8 are diagonal. Hence they commute. That is, 
A 3 A 8 — A 8 A 3 = 0. Quantum physics tells us that these therefore have simultaneously measurable 
eigenvalues. The simultaneous eigenvectors of these two matrices are 

(:)■(•)■(:) 



— , — — , — —J for/l 8 . If we plot these against each other 



(-l/2,V3/3) 



(l/2,V3/3) 



(0,-2V3/3) 



we obtain a diagram very much resembling how the up, down, and strange quarks show up on a graph 
of hypercharge. 



At this point in these notes, this paragraph is for advanced graduate students in physics. By the 
end of these notes, however, this paragraph should make much more sense to all readers. Given the 
above, doesn't it make sense to first learn about how to use action principles and the calculus of 
variations together with Noether's theorem to derive the differential equations of physics, then study 
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these differential equations using symmetry methods to find any Lie symmetries and the corresponding 
discrete commutator algebra of their infinitesimal generator realizations if any? The derived subalgebra 
may go down to span{0} under commutation as in example 1.13, or it may stop shy of span{0}, forming 
a discrete group (such as SU(2)) which can be copied by matrix representations with the same group 
structure. We learn what is simultaneously measureable in terms of the eigenvalues and eigenvectors 
of the representation matrices. Note that while the group may be discrete, the infinitesimal generators 
themselves are continuous, the underlying Lie point symmetries being continuous groups. If the X t form 
a linear vector space, then the local, continuous properties of these infinitesimal generators under 
commutation, e.g., [X 2 , X 4 ] = or =£0, relate to the measure of the curvature of a space in general 
relativity (in terms of the group of all coordinate transformations and connection coefficients), and 
similarly to the gauge filed vector potentials in quantum field theories (in both cases in terms of the 
commutators of the respective covariant derivatives). This unified overview should not take a decade to 
master beyond earning a doctoral degree in physics, as it did with me. It's physical underpinnings and 
mathematical grammar should be learned by the undergraduate between the sophomore and senior 
year, to be fully mastered during the first year and a half of graduate school where one should be 
learning the details of advanced mechanics, electrodynamics, quantum physics, thermodynamics and 
statistical physics, quantum electrodynamics, relativity, and possibly quantum fields with the power of a 
unified mathematical grammar and physical overview of where shit fits together and why it fits 
together. (Note— It doesn't generally go backwards uniquely from postulating matrix representations 
back to (infinitesimal generator) realizations, back to differential equations, but this is nevertheless also 
a valid approach to investigate theoretical universes and extensions beyond the Standard Model.) 

There is, of course, more mathematics and physics beyond the unified outline expounded on in 
this work, but it ties back. For now, let's get back to the ground. We still have to learn to crawl. After 
finishing up symmetry methods for first order ODEs in chapter 1, we shall proceed to extend (or 
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"prolong") these symmetry methods to higher order linear and nonlinear ODEs, and finally to linear and 
nonlinear PDEs. 

END Optional— 6 Page Double Spaced "BIG PICTURE" Motivational digression Example with Discussion 

Change of coordinates and the infinitesimal generator. How is the infinitesimal generator 
affected by a change of coordinates? Suppose (u, v) are new coordinates and let F(u, v) be an 
arbitrary smooth function. By the chain rule 



XF(u, v) = XF(u(x,y),v(x,y)) = f(x,y)d x F + r\{x,y)d y F 



dF du dF dv 
du dx dv dx 



+ 77 



dF du dF dv 
du dy dv dy 



= ^[u x F u + v x F v ] + r][u y F u + v y F v ] 



= fax + Wy)Fu + fax + yv y )F v = (Xu)F u + (Xv)F v . 
Without loss of generality, since F(u, v) is arbitrary, in the new coordinates 

X = (Xu) d u + (Xv) d v _ 

Thus X represents the tangent vector field in all coordinate systems. If we regard [d x , d y ) as a basis for 
the space of vector fields on the plane, X is the tangent vector at (x, y). The infinitesimal generator 
provides a coordinate free way of characterizing the action of Lie symmetries on functions. 

If (u, v) = (r, s) are canonical coordinates, the tangent vector is (0,1) and X = d s . Let 
G(r(x,y),s(x,y)) be a smooth function and F(x,y) = G(r(x,y),s(x,y)). At any invariant point 
(x,y), the Lie symmetries map F(x,y) to F(x,y) = G(f,s) = G(r,s + s). Applying Taylor's theorem 
and given X = d s , we get 



oo oo 

Ze J d ] G(r,s) V" 1 £ ] 



7=0 7=0 
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Reverting back to (x,y) coordinates, F(x,y) = ZJLo~7^ ; ^( x 'y)- If the series converges it is called the 

Lie series of F about (s, y). We have assumed that (s, y) is not an invariant point, but the expansion is 
also valid at all invariant points. At an invariant point X = 0, and only the j = term survives, which is 
F(x,y). We may express all of this in shorthand to F(x,y) = F{e £X x, e £X y) = e £X F{x,y). 



jo -i\ 

Example 1.14 — Ever wondered what e" o J means? Recall e x = 1 + x + — x z + —x s + but now 
x is a matrix. The expression therefore means 

G !K >4(! "c^+sC 

-G ?K "o 1 )-!^ -> 2 4G > 3+ - 

e + - i--e 2 + --y 

So ^ is the infinitesimal generator of rotations of the xy-plane. That is (~^p) = q^)- 

A finite rotation i9 is generated by the Taylor series expansion of e o /. i?(0)is a continuous group 
in 6. 

Lie symmetries can be reconstructed as x = e EX x, y = e £X y. Thus F{e £X x, e £X y) = 
e £X F{x, y). This generalizes to L variables, z 1 , ... , z L where the Lie symmetries are z 5 (z\ ... , z L ; £) = 

z 5 + £(z 1 , ... , z L ) + 0(£ 2 ), s = 1, ... , L. Then the one-parameter Lie group is Z = ^(z 1 , ... , z L ) 
Note that (Einstein) summation convention is used. If an index is used twice, then sum over all possible 
values of that index. Lie symmetries may be reconstructed from the Lie series z 5 = e £X z s . If F is a 
smooth function, F(e £X z\ ... , e £X z L ) = e^F^z 1 , ... , z L ). 
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,X _ -I , v , * 2 , 1 3 



Note that it is only sometimes easy to work from an infinitesimal generator back to a one- 
parameter Lie group. Consider for example X = d x + yd y . Then ^(x,y) = 1 and rj(x,y) = y. Looking 

at the definitions, = 1 and = y. Thus by visual inspection x = x + s and y = e E y 

work, and this is our Lie symmetry for our infinitesimal generator. 

A parting example 1.15 (optional)— In classical mechanics angular momentum is defined by 



L = 



i j k 

x y z 

Px Py Pz 



= t(yPz ~ z Vy)- K x Py ~yPx) + K x Py ~ yVx) = Lx + h + Lz 



In quantum physics we turn these quantities into differential operators. Recall from the digression that 
Px l—> ~~ ^~Ex m Tnen ' f° r example, L x -* L x = —ih (y ^ — z^j, L y -> L y = —ih (x-j^ — z-^j, and 
L z -* L z = —ih (x — y -^j. Let's study the commutators of {Z x , L y , L z ), e.g., 



/ o a \ /a a \ fa a \ fa a \i 



I y — ~ z ~) ' \ - - - z ^)-{ x dz- z dx)- ( y - " 2 



dz dy) \ dz '" dx) 



d d 
dz dy 



= ~ h2 [ y Yz{ x Yz) - y Tz( z Tx) ~ z Yy^Yz) + z Tyi z Tx) - x Tz( y Tz) 



dy 



dy 



+ X dz ( Z dy) + Z dx dz) Z dx ( Z dy)] 



d { d 
dy) 



= -h 2 



Xy dz 2 y dx yZ dxdz 



— xz - - + z 



— xy —r + x — + xz- 



dydz ' dxdy dz 2 dy dydz 



+ yz- 



d' 



— z 





d d 


= -h 2 


. y dx X dy. 



-h 2 L z . 



dxdz dxdy 

There is an easier way: the rotation matrices have the same commutator algebra. 
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R x (4>) = 



10 o 

cos0 — sin0 
sin0 cos0 



cosxp sirup 

10 
— smxf) cosi/; 



, R z {8) = 



cos 8 — sin 6 
sin 6 cos 8 




Taylor series expand the matrix elements to first order to get the infinitesimal generator versions: 




















1 







-1 











-1 


} 











} 


1 








.0 


1 


. 




-1 





0. 




.0 





0. 



The factor i is put in to match the signs with the angular momentum commutator algebra up to a 
constant, e.g., [R x , R y ] = —R z . The algebra of commutators formed by the rotation matrices under 
commutation defines a discrete group, SO(3). The matrices themselves have continuous parameters 
corresponding to continuous groups. 

When working with differential operators we speak of realizations of a symmetry. When 
working with matrices, we speak of representations of a symmetry. As we shall see later, it is often 
better to work with representations than realizations. Matrix representations are not necessarily 
unique though. The 2x2 Pauli matrices have the same commutator algebra up to a complex constant. 



ro in ro -ii rl i 

"* = li oJ' °y = u oJ' Gz = io -J 



-il 



ri o 



They represent the group SU (2) (special unitary group). The eigenvectors of a z are associated with 
electron spin, as opposed to rotations about an origin in classical physics. We can map the elements of 
SU(2) to 0(3) as well as the negatives of the elements of SU(2) to SO(3), a two-to-one mapping. 
When we get to algebraic topology and consider the geometric meaning of commutators, we will see 
that not having a 1-1 mapping between two groups tells us that they correspond to globally different 
spaces, much like a sphere and torus are topological^ different spaces (manifolds). The geometric 
meaning I allude to unifies the picture of quantum fields and general relativity. Let's attack higher order 
ODEs! 
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Part I . Chapter 2. (Accessible to sophomores; required for mathematics/physics majors up through the 
postdoctoral research level) On to higher order ODEs. (First full example for 2 nd order ODE at fifth page.) 

We prolong the symmetry tools for first order ODEs to higher order ODEs. Consider 

d k v (1) 
y^ = oy{x,y,y' y^), n>2, y™ = ^ 

Where wis locally smooth in its arguments. A symmetry is a diffeomorphism mapping the set of ODE 
solutions to itself. Any diffeomorphism T: (x,y) >—* (x,y)maps smooth planar curves to smooth planar 
curves. This action of T on the plane induces an action on the derivatives y^ k \ T: (x, y, y ' , ... , y ^) i— > 

(x,y,y', ...,y' n '), where = —— i k = 1, ...,n, called then th prolongation of T. 

The functions y^ are calculated recursively using the chain rule as follows: 

dy«-V D x j>0<-» ^ ^ (2) 

where D x = d x + y'd y + y"d y i H — . The symmetry condition: y ^ = a>(x, y, y ', ... , y ( n_1 )) when 
yC") = o)(x, y, y ' , ... , y ( n_1 )) is usually nonlinear. As with first order ODEs, Lie symmetries are obtained 
by linearization about e = 0, which is not possible for discrete symmetries (such as reflections). 

Example 2.1 — fx, y) = Q,^) is a symmetry of y" = 0, x > 0. Let's check. 

y(1) _ <*°y _ g * (|) _ + gjr + y"d y > + - ) g) _ ~ £ + / ■ | = y x> . 



,2 



K2) = dlyf = D * (y ~ xyf) = ^ + y ' d y + y " a y' + "• ) (y ~ xyf) = - y f + y f - y"* = 3 „ 

d£l D x (±) (d x + y'd y + y"d y , + -)(l) -± 
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Therefore y" = when y" = 0. The symmetry is its own inverse thus it belongs to a group of order 2. 
The general solution, y gen = c 1 + c x x gets mapped to y = ^ = c 1 +^- = c 1 + c 2 x. If you have had a 
little group theory you are probably familiar with the group containing {0,1} with the binary operation 
being sum modulo 1, (1 2 , +). 

The linearized symmetry condition for Lie symmetries for higher order ODEs is derived by the 
same method used for first order ODEs. Given an ansatz symmetry T: (x,y) >—* (x,y), the trivial 
symmetry corresponds to s = 0. The prolonged Lie symmetries are of the form 

x = x + et; + 0(s 2 ), 

y = y + £7] + 0(£ 2 ), (3) 

Where k > 1. The superscript r]^ is merely an index. Substitute (2) into y ^ = u> (x, y, y ' , ... , y ( - n_1 ' ) ). 
w(x,y,y', ...,y (n_1) ) = a) (x + £<f + 0(e 2 ),y + sr] + 0(e 2 ),y' + sr] m + 0(e 2 ), ...,y (n_1) + 



£J? (n-D + 0{e 2 )} = a) + [fa x + r]a) y ]s + [r] w a) y > + ■■■ + J? (n_1) w y („-o] e, 
where the linearized symmetry condition for an n th order ODE is 



?7 (n) = fa x + 7]0) y + r] (1) a) yl + •■■ + ^ n -^a) y (n-o (4) 
We find the r]^ recursively from (2). Recall » 1 — x for small x. Consider the case for k = 1: 



)(D = 



D x 9 i0) _ (d x +y'd y + y"d yl + -)y _(d x + y'd y + y"d yl + •••) (y + srj + 0(s 2 )) 



D x x (d x +y'd y +y"d y , + -)x (d x + y'd y + y"d y , + -)x = x + Et + 0(E 2 ) 
y' + sD x n + 0(s 2 ) 

= 1 + £D J +0 ( £ 2) = + £D ^ )(1 - sD *V = y + £D xV - y'eD x Z + 0(8 2 ) 
= y' + s(D x r,-y'D x O + 0(s 2 ). 
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So, 

V W = (D xV -y'D x O (5) 
Then continuing on to the k th step, we have 

<k) _ y (k) + eD x r]( k -V + 0{e 2 ) (6) 

9 ~ l + £D x t+0(£ 2 ) 

= (yW + eD x r)( k -V){l - eD^-V) + 0(£ 2 ). 

Thus, 

r] m {x,y,y' y k ) = (D x r]^ - y (k) D^) (7) 

Mimicking the notation of chapter 1, we may write this in terms of the characteristic Q = rj — by 
letting f = -Q y , n = Q-y'Qy, J? (k) = D k Q -y ik+1) Q y >, k > 1. 

Recall that for first order ODEs the RHS of the linearized symmetry condition is Xu>, X = %d x + 
rjdy, and the tangent vector to the orbit through (x,y) is J?) = ( — , — ) . For n th order ODEs we 

\D£ D£/ £—o 

have 

X™ = %d x + 7]d y + rF>d yl + ■■■ + J? (n) a y( „) (8) 
defining the prolonged infinitesimal generator. Thus X^ is associated with the tangent vector of the 
space variables (x, y, y ' , ... , y^). So far every symmetry we have met is a diffeomorphism of the form 
(x,y) = (x(x,y),y(x,y)), which we call a point transformation. Any point transformation that is a 
symmetry is point symmetry. Let us stick with point symmetries until further notice. Then for point 
symmetries we have <f = f (x, y) and r\ = rj(x,y) only. These components of the tangent vector do not 
depend on y',y", .... Assuming that we have our symmetry (x,y) = (x(x,y),y(x,y)) and the 
corresponding tangent vector (f , r], ) let's make the first few cases of equation (7) explicit, say for 
k = 1,2,3. For k = 1, 
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ri w = D x r,-y'D^ (9) 
= (d x + y'd y + y"d y/ + -) V 
-y'(d x + y'd y + y"d y , + -)f 

= Vx + y'n y - y'S x - t y y' 2 = Vx + (% - Qy' - t y y' 2 



For k = 2, 



r}W = D xV W-y"D x S (10) 
= & + y'3 y + y"d y , + -)(r, x + (r, y - Qy' - f y y' 2 ) 
-y"(d x + y'd y + y"d yl + ■■■)!; 

= *ixx + y'nxy + y' 2 n yy +y'nxy - y'Sxx - y' 2 ^ xy + - 

= Vxx + ( 2r lxy ~ fxxty + (Vyy ~ ^xy)y' 2 ~ S yy y' 2 

+ ( % - 2f x - 3f y y')y". 

For k = 3, 

^ = Vxxx + (^TJxxy ~ ^xxx)y + ^(jlxyy ~ ^xxy)y (H) 
"I" (jlyyy ~ ^xyy}y ~ %yyyV 
+ 3(jfc y - <fxx + (% y - 3^ y )y' - 2^ yy y' 2 )y" 

-^ y y" 2 + (r]y-^x-^yy')y'"- 

It gets increasingly monotonous. To keep things manageable and clear, let's consider second-order 
ODEs of the form y" = u>(x,y,y'). The linearized symmetry condition is obtained by substituting rj^ 

into r]^ = ^u> x + T]a) y + r]^a) y i, and then replacing y"by o)(x, y,y'). We get 

t? (2) = Vxx + faxy ~ txx)y' + (?7yy - 2^ xy )y' 2 - ^ yy y' 3 + (r] y - 2^ x - 3% y y ')o)(x, y, y ') 
= %a) x + r]0) y + r] w a> y > = ^a) x + 7]a) y + (rj x + (r} y - $ x )y' - <f y y' 2 )&y 
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Though the equation looks complicated, it is often easy to solve. As both f and r\ are independent of y' , 
we may decompose the linearized symmetry condition into a system of partial differential equations 
(PDEs), which are the determining equations for the Lie point symmetries. 

Example 2.2 — Consider y" = 0. Our goal is to find a Lie point symmetry. Yes we are going overboard 
with a very simple 2 nd order ODE, but what we learn will greatly simplify not-so-simple 2 nd order (and 
higher order) linear and nonlinear ODEs (see next example). Note u> = 0, u> x = 0, u) y = 0, ay = 0. 

Thus 7]^ simplifies to r\ xx + (2t] xy — % xx )y' + {j] yy — 2^ xy )y' 2 — ^ yy y' 3 = 0. As both ^ and r\ are 
independent of y' , the linearized symmetry condition splits into the following system of determining 
equations: 

VXX = 0, 2/y x y — ^ xx = 0, Yjyy — 2^ X y = 0, fyy = 0. 

The general solution for % yy = is ^(x,y) = A(x)y + B(x). Take two partial derivatives wrt to y to 
verify that indeed % yy = 0. Now consider the third equation r\ yy — 2% xy = 0. Then 

d d d 
Vyy = 2% xy = 2— — [A(x)y + B(x)] = 2^0) = 2A'{x). 

Integrating twice we get rj = A'{x)y 2 + C(x)y + D(x). Then rj x = A"{x)y 2 + C'(x)y + Z)'(x), and 

Vxx = A"'(x)y 2 + C"(x)y + D"(x) = 0. (12) 
What is % xx ? First % x = A'(x)y + B'(x), then % xx = A"(x)y + B"(x). Then the second equation tells 
us 27] xy = A"{x)y + B"{x). On the LHS, 2r] xy = 2 ■ (2A"(x)y + C'(x)). So with LHS = RHS we get: 

3A"(x)y + 2C'(x) - B"(x) = 0. (13) 
Ify * in (12), then A"\x) = 0andC"(x) = 0, andD"(x) = 0. Ditto if in (13) then A"(x) = 
0, and therefore 2C'(x) = S"(x). Integrating A"(x) = gives usA(x) = c a + Cpx. Integrating 
C"(x) = gives C(x) = c 5 + c y x. Therefore, B"{x) = 2C'(x) = 2c y . Integrating B"{x) once we get 
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B'(x) = 2CyX + cq. One more integration gets us: B(x) = c y x 2 + c e x + c p . Repeating for D"(x) = 0, 
we get D(x) = c x x + c r Thus our Lie point symmetry is 



Let's re-label the Greek indices with Arabic numerals: Then ^(x,y) = c x + c 3 x + c 5 y + c 7 x 2 + c 8 xy 
and J?(x,y) = c 2 + c 4 y + c 6 x + +c 7 xy + c 8 y 2 . Now 

Z (n=0) = + ^ + v (i) dyl + ... + v in) dyM = + v g y 

= (c x + c 3 x + c 5 y + c 7 x 2 + c 8 xy)d x + (c 2 + c 4 y + c 6 x + +c 7 xy + c 8 y 2 )d y . 

The most general infinitesimal generator is X = Yf=i c^where 

X t = d x , X 2 = dy, Z 3 = xd x , X 4 = ydy, X 5 = yd x , X 6 = xd y , 
X 7 = x 2 d x + xydy, X 8 = xyd x + y 2 d y 

,2 

Example 2.3 — Consider the nonlinear ODE y" =^ — y 2 . Recall the linearized symmetry condition 

?7 (2) = Vxx + faxy ~ txx)y' + {Vyy ~ ^xy)y' 2 ~ SyyV' 3 + (Vy ~ ^x ~ ^ y y')^{x,y ,y') 

= ^0) X + T]Q)y + T] W 0)y' = ^0) X + T]Q)y + (j] % + (fj y ~ ^)y' ~ ^'^(xty' 

The term <y(x,y,y') is the RHS of our nonlinear ODE. The term (jl> x is zero. The term w y is — 2y. 
The term u> y i is 2y'/y. Thus for our nonlinear ODE our linearized symmetry condition is 



^(x,y) = yl(x)y + B(x) = c a y + Cpxy + c y x 2 + c e x + c p , 



rj(x,y) = A'{x)y 2 + C(x)y + D(x) = Cpy 2 + (c 5 + c y x)y + c x x + c x . 
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We proceed as before by matching powers. Matching powers of y' leads to the determining equations 

1 (14) 

E + -E =0 

^yy^y^y u> 

1 1 (15) 

T\yy — 2E X y ~ -f]y + ~^T\ = 0, 

V xx -y 2 (Vy-2E x ) + 2yr] = 0. (17) 
Abusing notation, let's integrate the first of these equations 



J J y 



We get In E y + In y + In Z(x) = 0, where Z(x) is some arbitrary function of x. This can be rewritten as 
ln|fj,yZ(X)| = 0. So, E y = l/(Z(x)y). Integrating again gives us E = (1/Z(x)) ■ ln|y| + B(x), where 
B(x) is another arbitrary function of x. Let 1/Z(x) = A(x). Then 

E = A(x)\n\y\ + B(x). (18) 
You can check this by taking d yy . Integrating the second of the equations yields 

r] = 4'(x)y(ln|y|) 2 + C(x)y ln|y| + D(x)y, (19) 
where, as usual, the functions of x are arbitrary. Substituting (18) and (19) into (16) results in 

3A"(x) ln|y| + 3A(x)y + 2C'(x) - B"(x) = 0. (20) 

Ify * 0, then 

A(x) = 0, B"(x) = 2C'(x). (21) 
Substituting (18) and (19) into (17) results in (remembering A(x) = 0.) 

C(x)y 2 ln|y| + C"(x) + (2B'(x) - C(x) + D(x)y 2 ) + D"(x)y = 0, 
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which splits into the system 

CO) = 0, D(x) = -2B'(x), D"(x) = 0. 
Taking into account equations (21), we see that 

B{x) = c x + c 2 x, D(x) = —c 2 , 

where the constants c x and c 2 are arbitrary. Hence the general solution of the generalized symmetry 
condition is ^(x,y) = c x + c 2 x, rj(x,y) = —2c 2 y. 

I'll bet that when I said symmetry methods for solving differential equations are based on 
making good guesses on symmetries, you thought that symmetry methods are just as full of crap as 
anything else. Maybe only a genius could cook up a symmetry for the Riccati equation. Not so. In this 
example we began with an ugly, nonlinear, 2 nd order ODE and through the machinery of symmetry 
methods produced the tangent vector , rj) to a symmetry of our ugly ODE. It may not be easy to work 
from the tangent vector back to the symmetry, but the tangent vector hasn't yet been fully exploited. 
Recall that our goal is to find solutions to our ODE. 

Let's use our two infinitesimal generators to look directly for possible invariant solutions from 
the characteristic equation for each generator. Recall from chapter 1 that every curve C on the xy- 
plane that is invariant under the group generated by a particular X satisfies the characteristic equation: 
Q(x,y,y') =r\ — = on C. Let's try it forX^ We know X-y = d x , and thus forZ 1( ^ = 1 and 
r\ = 0. Thus for X r the characteristic equation is — y' ■ 1 = 0. The solution to this characteristic 
equation is y = c, where c is an arbitrary constant. If you plug in this possible solution into the ugly ODE 
it works. So y = c is a confirmed solution. Now for our second characteristic equation for X 2 . Here 
^ = x and rj = —2y, hence we determine when — 2y — y' ■ x = 0. The solution to this simple ODE is 
7 = Yo/* 2 where y is an arbitrary constant. Is this solution a solution to our nonlinear ODE? Plug in 
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and check. First let's compute the derivatives: y = f 2 , y' = , y" = ^. Plug these into 

y" = y - y 2 to get 

6yo = 4y^_ 2 _ 4y 2 x 2 y 2 _ 4y y 2 
x 4 x 6 y ^ x 6 y x 4 x 4 x 4 ' 

This simplifies to 6 = 4 — y , or y = —2. Thus y = — 2/x 2 is a solution. Check it: 

v » = -^ = ^- v 2 = -Y--V- = -- 
y x 4 y ^ x 6 \ 2 / x 4 x 4 ' 

Not bad. Be careful. For linear ODEs the sum of solutions is a solution. This is not generally so for 
nonlinear differential equations. We have found two distinct solutions: y = c and y = — 2/x 2 . 

Get ready for some excitement— the useful union of abstract algebra to differential equations. 
We will reduce our ODE down to an equivalent algebraic equation. Let's first check if the algebra of the 
infinitesimal generators of our ODE is solvable. That is, let's check to see whether {X 1 ,X 2 } >—* ••• >— » {0} 
or not under commutation. Well, 

[X V X 2 ] = d x {xd x - 2yd y ) - {xd x - 2yd y )d x = d x + xd xx - 2yd xy - xd xx + 2yd xy = d x = X^ 

Since [X^XJ = 0, {X 1 ,X 2 } >—* i^i) >—* {0}- To go from {X X ,X 2 } to {0} requires two steps. Thus our 
2 nd order ODE can (at least in principle) be integrated twice via differential invariants/canonical 
coordinates. [ I owe you a proof of this, and you will get it .] One technique for reducing the order of a 
differential equation is the reduction of order using canonical coordinates. We've used canonical 
coordinates already for solving an example in chapter 1. Another technique involves computing 
differential invariants (this approach will be presented after canonical coordinates). When the algebra is 
solvable, we get the best of these approaches. 
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Since we have used canonical coordinates before, let's use them to reduce the order of our 2 nd 
order ODE down to first order. Actually, you'll see that we can reduce our particular 2 nd order ODE to 
two distinct 1 st order ODEs depending on our choice of canonical coordinates. Recall that we can use 
canonical coordinates when the ODE has Lie symmetries equivalent to a translation, e.g., (x,y) = 

(x, y + s). For X 1 = d x , we have <f = 1 and r] = 0, so (chapter 1) s (r, x) = j^^ j ^ ^ = 
f — = x and — = 77^-7 = -. Thus y = y„ = constant = r. So our canonical coordinates are 

J 1 dx f(x,y) 1 J ■ /0 

(r, s) = (y, x). Then — = 1 and — = y and so — = dsl dx h- dr I dx = -7. Let v = — = \ With 

vy dx dx J dr V dr y' 

dv y" , dr . 

— = — j2 and — = y we get 

dx y' z dx J & 

dv 

dv = dx~ = d s = y 

dr dr dr 2 y' 3 ' 
dx 

Dividing our ODE by y ' and rearranging terms we get to 

y" _y 2 1 
y' 3 y' 3 yy r 

Combining the two result above gives us the following first order ODE: 



dv y 1 2 3 v 
dr y' 3 yy' r 

On the other hand, if we let v = - = y' , then — = y" , and with — = y' we get 

s J dx J dx J 

dv y" y' y 2 v r 2 
dr y' y y' r v 

I suppose which choice of v is better is the one that produces the easier reduced ODE to work with. 
Regardless, we have reduced a 2 nd order ODE into one or another first order ODE, but according to the 
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fact that we have two Lie point symmetries, we can transform our 2 nd order ODE down to an algebra 
equation. Although we will need to build more machinery to more systematically reduce ODEs to lower 
order you have enough background to peek ahead and see how to take our particular 2 nd order ODE 
down to an algebra equation. You'll have to take one result on my word until we build up this math. 

So far we have only used the first infinitesimal generator X 1 = d x of our 2 nd order ODE. Let's 
proceed to use the second infinitesimal generator X 2 = xd x — 2yd y . To keep things clear we will use 
subscripts. Corresponding to generator X t we have canonical coordinates (r^s-J = (y, x). Using the 
subscript 2 for X 2 , we have % 2 = x ar| d r\ 2 = —2y., and equation (8) reduces to 

The method of characteristics tells us 

dx dy dy' (23) 

(l) 

What is ? Equation 9 tells us that 

= r ii x + (j? 2y - %2 X )y' - $2 y y' 2 - 

This reduces to rjtp = (—2 — l)y' = —3y'. So equation (23) becomes 

dx dy dy' (24) 
x 2y 3y r 

3 _3 

Let's work with the last two terms. Integrating the last two terms gives y' = y*. Thus y'y 2 = 
constant = r 2 . Until I cover the material for differential invariants you will have to take my word that : 

v 2 = — (see example 2.7). Our canonical coordinates are (r 2 , v 2 ). Notice that if I rearrange the 

y" y" y' 2 y' - y' 

original ODE to match — we get v 2 = — = — — 1 = -5—3 — 1 = r 2 — 1, and there you have it. A 

y y y y2-yi. 
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second order ODE turned into an algebraic equation. Since we're not interested in voodoo, here is 

y" 

what I owe you: the theory of differential invariants to get to v 2 = I also owe you the connection 

between the solvability of the Lie algebra, {X lt X 2 } >—* {X-i} >—* {0}, and the ability to integrate our 
2 nd order ODE stepwise by two integrations. We will get here soon. We will do so for our particular 
example, taking it to completion, and we will do so in general for any ODE and its Lie algebra. 

It's remarkable how we've treated our 2 nd order ODE by assuming that at least one Lie point 
symmetry exists and using the linearize symmetry conditions to get tangent vectors to the Lie 
symmetries, to get some invariant solutions, to get the infinitesimal generators X x and X 2 , to get 
canonical coordinates, to reduce our ODE down to two different first order ODEs [no voodoo through 
here], and finally reduce the 2 nd order ODE down to a polynomial. Let's do two more examples of 
reduction of order using canonical coordinates before formalizing the examples into our grammar 
afterwards. 

Example 2.4 -Consider the 2 nd order ODE y" = (| - 2x) y ' + Ay. 

Since I did every step in using the linearized symmetry condition, I will forego all of that here and state 
that one of the infinitesimal generators is X = yd y . So for this generator f = and r\ = y. Given this, 
we may derive the canonical coordinates (r, s) = (x, ln|y |). We have seen these before. Then we get 

ds 

dr dr_ y ' 

dx 

We are clearly aiming to reduce the order of our ODE from two to one. When we "prolong" v, we get 

A — " < 2 

dv = dx _ d s = y y 

dr dr dr 2 y y 2 
dx 
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So 



2 

y" dv y' 
y dr y 2 ' 



If we divide our ODE by y, we get 



V \X I V 



Combining the two above equations gets us 



y" dv y' 2 dv {3 \ 

— = — — I — =- = — + v l = 2r]v + 

y dr y z dr \r I 



Thus, again, we arrive at a first order equation (in this case a Riccati equation): 

dv /3 



. +4--V' 

dr 



= (-~ 2r ) v 

Wikipedia writes a general Riccati equation as y' = q t (x)y 2 + q t (x)y + q (x). 

Example 2.5 — Being a little adventuresome. Consider y" = ^- + (y — ^ y' . 

Again, exploiting the linearized symmetry condition, we can determine that one of the infinitesimal 
generators is X = d x . (These translations are the only Lie point symmetries of our ODE.) Since ^ = 1 

and 77=0 we get canonical coordinates (r, s) = (y, x). With — = 1 and — = y', let v = — = ds/dx 
dr I dx = ~jm With — = — ^ and — = y'we get 

t' dx v dx y 



dx 
Then 



dv 

dv = it = d s = y" 

dr dr dr 2 y' 3 ' 



dv 
dr 



y^_ = (\_ \J 1 _ = (\_ r \ v 2 _ v _ 

y' 3 \y Vy ,z yy' \r r / r 



This is a Bernoulli equation whose solution is given in the typical botany-based class in ODEs. What if 



dr dr_ y' y V y) r V r) 
dx 

The result is a linear ODE, yet another of the ODEs studied in a regular, botany-based ODE class. 
iBotany? Ha! We don't need no stinckin' botany. Vamonos! 

So far we have been able to reduce the order of our 2 nd order ODEs by one because each of the 
these 2 nd order ODEs have had at least one Lie point symmetry, and therefore one corresponding 
infinitesimal generator extracted from the linearized symmetry conditions. We don't need the actual Lie 
point symmetries because we extract what we need from the tangent vectors of these Lie point 
symmetries which we get from the linearized symmetry condition. Some of our ODEs have actually had 
two infinitesimal generators extracted from the linearized symmetry conditions, and in some cases 
these pairs of generators have formed a solvable Lie algebra. For these 2 nd order ODEs with solvable 
algebras I have claimed that we can integrate them stepwise two times. We haven't bothered to do this 
for the prior two examples because the reduced 1 st order ODEs we have arrived at are straightforward 
1 st order ODEs that we can readily solve. Let's formalize this machinery of reducing the order of an ODE 
by using canonical coordinates. Then we will go over an example reducing a 3 rd order ODE down to a 1 st 
order ODE. Ultimately we will use stronger machinery to more fully treat example 2.3. What follows is 
the formalization of the reduction of order technique we used in examples 2.4 and 2.5 using canonical 
coordinates. 



instead of choosing v 



ds 1 

= — = — we choose v = y '? Then dv/ dx = y" and dr/ dx = y'. Then 



dr y 



dv 
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Reduction of order by using canonical coordinates : From now on we shall denote differentiation 
by r by a dot (■). For example, s denotes ds/ dr. Suppose that X is an infinitesimal generator of a one- 
parameter Lie group of symmetries of ODE 

= co(x, y,y' y (n - 1} ), n > 2. (22) 

Let (r, s) be canonical coordinates for the group generated by X, so that X = d s . If ODE (22) is written 
in terms of canonical coordinates, it is of the form 

d k s (23) 
s^ = a(r,s,s s<*-»), s {k) =^- 

for some fl. However, ODE (23) is invariant under the Lie group of translations in s, so the symmetry 
condition gives fl s = 0. Therefore 

S W = (l(r,j s^-V), s^=^. (24) 

By writing ODE (22) in terms of canonical coordinates, we have reduced it to an ODE of order n — 1 for 
v = s. This is just what I did in example 2.3 just south of equation (24). So with v = s, 

d fe+1 ? (25) 
v^ = a{r,v v^-V), v Wi = ^l. [ } 

Suppose (assume) that the reduced ODE has general solution 

v = /( r; Cl , ...,c n _ 1 ). 
Then the general solution of ODE (22) is arrived at by integration, 



rr(x,y) 

s (x, y) = J f(r; c lt ... , c n _i)dr +c r , 



More generally, if v is any function of {s , r} so that v x (r, s ) ^ 0, then(24) reduces to form 
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d k v (26) 
v (.n-i) = a(r tV V m =^- 

Once the solution of (26) is known, the relationship 5 = s(r, v) gives the general solution of (22): 

r-r(x,y) (27) 
s(x,y)=\ s(r;v(r;c 1 ,...,c n _ 1 )dr+c n . 

In summary, once we find a one-parameter Lie group of symmetries using whatever means (say a good 
guess) or the tangent vectors to any such one-parameter Lie group via the linearized symmetry 
conditions), we can solve ODE (22) by solving a lower-order ODE, then integrating. This is what we have 
done in examples 2.3 through 2.5. 

On Differential Invariants and Reduction of Order : In just about as much theory of the previous 
section we will have the differential invariants method to reduce the order of a differential equation. 
We have seen that a single Lie point symmetry allows us to reduce the order of an ODE by one. 
Sometimes a double reduction of order can happen if there are two Lie point symmetries. In fact one 
can reduce an n th order ODE with R < n Lie point symmetries to an ODE of order n — R, or to an 
algebraic equation if R = n. 

If X generates Lie point symmetries of the ODE 

y (n) = w(x,y,y' y (n - 1} ), n>2 (28) 

then, in terms of canonical coordinates (r, s), the ODE reduces to 

V ( n -V=n(r,v v^-^), (29) 

Where v = v(r, s) is any function such that Vj 0. The reduced ODE consists entirely of functions that 
are invariant under the (prolonged) action of the group generated by X = d s . These functions are called 
differential invariants. A nonconstant function l(x,y,y' , ...,y^) is a k th order differential invariant of 
the group generated by X if 
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XWI = 0. (29) 
In canonical coordinates, X^ = d s , so that every k th order differential invariant is of the form 
/ = F(r, s, ... , s^), or equivalently, 

I = F(r,v v^-D) (30) 

for some function F. The invariant canonical coordinate r(x, y)is the only differential invariant of order 
zero (up to function dependence). All first-order differential invariants are functions of r{x, y, y ') and 
v(x,y,y'). Furthermore, all differential invariants of order two or greater are functions of r, v and 
derivatives of v wrt r. Therefore, r and v are called fundamental differential invariants. We can usually 
find a pair of fundamental differential invariants without first having to determine 5. From equation 
(29), every k th order differential invariant satisfies ^I x + r\l y + — I- tj^I m = 0, 

so (by the method of characteristics), I is a first integral of 

dx _ dy _ _ dy (k) (31) 

In particular, r is a first integral of ^ = — , and vis a first integral of ^ = — = Sometimes it is 
necessary to use r to obtain v. 

Example 2.6 — Find fundamental differential invariants of the group of rotations generated by 
X = —yd x + xd y . Thus ^ = — y and rj = x. Then — = - = — -. Solving this simple ODE leads to 
x 2 + y 2 = constant = r 2 . I let the constant be r 2 because the left hand side is the equation of a circle. 
Then r = yjx 2 + y 2 . Note that Xr = {—yd x + xd y )Jx 2 + y 2 = 0. That is Xr = 0. We already know 

dy x dx dy dy f 

that r is a first integral of — = — . Now on to v. It is the first integral of = — = -rrr. Well 

dx y y x r\^> 

= r lx + ijly ~ %x)y' ~ ^yy' 2 = 1 + y" ■ So v is a first integral of 
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dx dy dy' 
y x 1+y' 2 ' 

To keep things simple we restrict attention to the region x > 0, where — = , ^ y . Note that 

x *jt —y 

f dy , 2 = tan -1 y' and f dy , 2 = f , f y = = sin -1 - = tan -1 -. So tan -1 y' — tan -1 - = constant. 

J l+y' ^ J l+y' J Jr 2 -y 2 r x J x 

Then the first integrals are of the form I = F (r, tan -1 y' — tan -1 Since tan -1 y' — tan -1 ^ is 
constant so is tan (tan -1 y' — tan -1 -) = — — 7 by identity. Then it's convenient to let v = — — 7. 

\ ^ x/ x+yy' x+yy' 



What is 5? By definition, 



Kr,x) = (\ - f dX t ) = -( d ^=-(-t= 

\J £{x,y(r,x))J r=r{xy) J y J J r 2-x* 



= sin - = tan 
r 



Let's compute s, or — . 

dr 

_A 

ds 1 V* * 2 / 

^ = d5 = dx" = + x 2 1 (xy' - y) 

dr dr -(x + yy f ) '" ^/ x 2 + y 2 (x + yy')' 

dX ( X 2+y2) 1 / 2 

Notice that v = rs. We can think of 5 as angular velocity and vas the tangential velocity. 

An ODE that has more than one Lie point symmetry can be written in terms of the differential 
invariants of each generator. Thus the generators themselves can be written in terms of functions that 
are invariant under all of its symmetries. Let £ denote the set of all infinitesimal generators of one- 
parameter Lie groups (the binary operation being commutation) of point symmetries of an ODE of order 
n > 2. The linearized symmetry condition is linear in ^ and rj by construction, and so 

X lt X 2 eL^ Cl X r + c 2 X 2 y c v c 2 e R, 
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Where {X x ... , X R ) is a basis for £. The set of point symmetries generated by all X e £ forms an R- 
parameter (local) Lie group called the group generated by £. (The order of an ODE places restrictions on 
R. For 2 nd order ODEs, R = 0,1,2,3, or 8. R = 8 iff the ODE is linear, or is linearizable by a point 
transformation. Every ODE of order n > 3 has R < n + 4. If this ODE is linear or linearizable, then 
R = {n + 1, n + 2, n + 4}. These results have been offered without proof.) 

Because [X x ... , X R ) is a basis for £, the fundamental differential invariants of the group 
generated by £ are solutions of the system 





7?1 


(1) 

m 

CD 
m 


m 

(R) 

m 


r h i 

h 
W 




o- 








(i) 

Tr • 


(R) 
■ Vr J 


7 y(«). 




-0- 



(32) 



(A good example is coming up.) The system has two functionally independent solutions if the matrix on 
the LHS has rank R. These solutions can be determined via Gaussian elimination and the methods of 
characteristics. One solution is independent of and is denoted by r R . We denote the other solution 

v R , which depends nontrivially on y^. As ^ Vr "/ depends on y( R+1 ), and so on, ODE (22) reduces to 

V (n-R)_ a ( V ( n - R -V\ 

v R — \l \r R ,v R , ...,v R j, v R — ^ k 

for some function H. Thus an R- parameter symmetry group enables us to reduce the order of the ODE 
byi?. 

Example 2.7 — Consider y ^ = ^ (1 — y')y"' . Is this ugly enough for you? As in example 2.3, you 

would apply the linearized symmetry condition to find ^, r\, r]^ , ... , r]^ lv \ From these we would find the 
infinitesimal generators. Recall example 2.3. There we got ^(x,y) = c x + c 2 x, and rj(x,y) = — 2c 2 y. 
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Thus there were two constants in that example, and (if you go back) we had two infinitesimal 
generators, namely, X ± = d x and X 2 = xd x — 2yd y . Doing this math for our 4 th order ODE you get: 

X 1 = d x , X 2 = xd x + yd y , X 3 = x 2 d x + 2xyd y . (33) 
So R = 3, and for^: & = 1, m = 0, V? = 0, = 0, ij® = 0. ForZ 2 : <f 2 = x, r) 2 = y, r£> 

(2) (2) 

0, t 2 = ~y". m = -2y'"- The result for rj 2 follows from substituting ^ 2 ar| d rj 2 into (9): 



(i) 



= m x + (rj 2y - f 2x )y' - ^ y y' 2 = o + (1 - D ■ y' - o = o. 



The result for r\p results from substituting % 2 , r\ 2 , and r\P into equation (10) 



2 2) = m xx + {^2 xy - ^2 XX )y' + (v2 yy - ^2 xy )y' 2 - Z 2yy y' 2 + (m y - 2f 2x - ^ 2y y')y" 



= + (0 - 0) ■ y' + (0 - 0) ■ y' 2 + (1 - 2 - 0) ■ y" = -y". 



The result for r^p results from substituting % 2 , r\ 2 , ifp into equation (11) to get (you do the math) 
ifp = —2y"'. For the third index ^ 3 = x 2 and j? 3 = 2xy. Repeating the use of equations (9), (10) and 
(11) gives us r]^ = 2y, r)P = 2{y' — xy") and rj^ = —\xy"'. Thus we get 



1 

x y 
x 2 2xy 





-y" -2y"' 

2y 2(y' - xy") -Axy' 



lylll 



After Gaussian elimination we get 



-1 











] 





y 





-y" 


-2y"' 


.0 





y 


y' 






ly'" 



(34) 
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So / = I(x, y, y ' , y"y"'). Now use each equation of (34) to determine the differential invariants. The 
third equation is 

yly + y'I y n = 0. 

dv f fiv ff 

Using the method of characteristics we get — = -p-. Solving this leads to J y' dy' = y J dy" , or, 
i y ' 2 = yy" + c . Since y' 2 — 2yy" is constant, it is one of our differential invariants. So 

I = l(x,y, 2yy" - y' 2 ,y"') 

The second equation from (34) is 

yl y - y"l y n - 2y"l y ,n = 0. 
The method of characteristics gives us — = — -^r = — -^777. Integrating the first and third terms 

O y yll 2y"' 

lny = — iiny'", ory'" = c/y 2 . So y 2 y"' is constant. 

I = I(x, y, r 3 , v 3 ) = l(x, 2yy" - y' 2 , y 2 y"'). 

We've eliminated y. The third equation is I x = 0, or via the method of characteristics dx/x = 0. Then 
x = c. Therefore / = /(2yy" — y' 2 ,y 2 y"'). So the fundamental differential invariants of the group 
generated by our generators (33) are r 3 = 2yy" — y' 2 and v 3 = y 2 y"' . Higher order differential 
invariants can now be computed, say dv 3 /dr 3 . 



dv 3 _ D x v 3 _ (d x + y'dy + y"d y , + + y'"d y „ + + y^d y „, + -)v 3 2yy'y"' + y 2 y^ 



iv) 



dr 3 D x r 3 (d x + y'dy + y"d yl+ + y'"dyn + +yWdyn, + -)r 3 2y'y" - 2y'y" + 2yy"' 

2y'y"' + yyW yy m 

= = h v' = 1. 

2y"' 2y"' y 
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Note that our ODE y (w> = - (1 — y')y"' , when rearranged is 2y ,„ + y ' = 1 = constant(a differential 
invariant). Solving ^ = 1 gives us 

v 3 = r 3 + c x . 

The ODE has been turned in the algebra equation v 3 = r 3 + c x equivalent to a 3 rd order ODE, namely, 

2 yy" - y' 2 + C± 

y = 2 ■ 

This 3 rd order ODE is invariant under the three parameter Lie group generated by £. By the way, I have 

y" 

now showed you the method by which I got v 2 = — back in example 2.3. 

Of course we can proceed backwards. A set of fundamental differential invariants can be used 
to construct ODEs that have given Lie point symmetries. If (r R , v R ) are fundamental differential 
invariants of an R- dimensional Lie group G, then every ODE (28) of order n > R that has G as its 
symmetry group can be written in the form 

vt* ) = a(r R ,v R vt^), < 35 > 

for some function F. By expressing (35) in terms of (x, y, ... y one obtains a family of ODEs that 
have the desired symmetries. Some of these ODEs may have extra symmetries. Let's quickly see how 
this "going backwards" idea works. After this we finally get to the solvability theory. 

Example 2.8 — Suppose that the fundamental differential invariants of the three-parameter group 
generated by X x = d x , X 2 = d y , X 3 = xd x + yd y are r 3 = y ' , v 3 = y"'/y" . The most general third- 

order ODE with these symmetries is v 3 = F(r 3 ), which is equivalent to y'" = y" F(y'). The most 
general fourth-order ODE with these symmetries is equivalent to dv 3 /dr 3 = F(r 3 , v 3 ). First let's 
compute dr 3 /dx. We get dr 3 /dx = y" . Now let's compute dv 3 /dx. Weget 
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dv 3 = y^y" 1 - 2y" a y' 

dx y" 4 



So then 



^ _ dv 3 _ y^y" 2 - 2y"' 2 y" _ y<& 2y"' 2 _ ( , y' 



dr 3 dr 3 y" 5 y " 3 y" 4 F \'y" 2 

dx 



Thus 



2 



y m = 2 Yr + y" 3 p(r 3 ,v 3 y 

As they say in today's Air Force, the bottom line up front (BLUF) is: If an ODE has R < n Lie 
point symmetries, we can reduce its order from n to n — R. If R = n, and if the algebra L is solvable 
then (at least in principle if the manipulations are doable) we may, additionally, integrate the ODE R 
times to solve it. This is a theorem. It requires proof, which requires some more foundations. Please 
skim the rest of this chapter at a minimum for now if you've just finished a sophomore course in ODEs 
and you wish to keep going with applications to ODEs and PDEs in chapter 3. The rest of this material is 
IMPORTANT if you are beginning graduate studies in physics so that you better understand the 
mathematical engine underlying quantum physics, or if you're either planning or are already doing work 
in particles and fields, even as a post-doctoral research fellow. The material here on the classification of 
symmetries is well developed via realizations versus the pedagogical half picture via matrix 
representations. Of course I will include examples, and I will try to highlight the important stuff in bold . 
DON'T let the upcoming theory derail you from the momentum you have in applying symmetry 
methods for ODEs. DON'T worry about totally mastering the following theoretical material until you 
have the practical methods down pat. Lie point symmetries ARE NOT the only symmetries we can 
exploit regarding differential equations. We'll meet some of these other symmetries in this chapter. 
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Proof Section to Theorem (Some grammar/theory first) — If R = n, and if the algebra £ is 
solvable then (at least in principle) we may integrate the ODE R times to solve our ODE. Let's suppose 
that the Lie point symmetries of ODE 

yW = co(x,y,y' y (n - 1} ), n>2 (1) 

are generated by £, which is R -dimensional. We know (and we have seen from several examples) that 
we may rewrite ODE (1) in terms of differential invariants (r R ,v R ) to obtain an ODE reduced down to 
order n — R, leaving us with an algebraic equation, 

v R = F(r R ; c-y, ... , c n _ R ), 

which is equivalent to an ODE of order R with the i?-parameter group of symmetries generated by £. 
To answer our theorem we need to learn more about the structure of £ (stuff that is very important to 
graduate students of physics ). 

Suppose thatZ 1( Z 2 e A where 

%i = Zi(x,y)d x + rji(x,y)d y , i = 1,2. (36) 
The product X X X 2 is a second-order partial differential operator: 

X X X 2 = ^ 2 d x 2 + tf lJ?2 + rj^ 2 )d x d y + rj^d/ + (X^ 2 )d x + (X^dy, 

where the last two terms have come from the chain rule. The product X 2 X X has the same 2 nd order 
terms as X 1 X 2 , but first order terms (from the chain rule) of (X 2 ^{)d x + (X 2 rj 1 )d y . So the commutator 

[X 1 ,X 2 ]=X 1 X 2 -X 2 X 1 (37) 
= - *2?i)3* + (*ii?2 - X 2 rii)dy. 

The commutator has many useful properties. Here are a few. It is antisymmetric: [Z 1( Z 2 ] = —[X 2 ,X 1 ]. 
The commutator satisfies the Jacobi identity 
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[x lt [x 2 ,x 3 ]] + [x 2 , [xm] + [x 3> [xm] = o. 

The commutator is bilinear, i.e., linear in both arguments: 

[cA + c 2 X 2 ,X 3 ] = cdXM + c 2 [X 2 ,X 3 ], 

[X 1>C2 X 2 + c 3 X 3 ] = c 2 \X x ,X 2 \ + c^XM, 

where the q are arbitrary constants. 

The Lie algebra is invariant under a change of variables. Let's check this. Under a change of 
coordinates from (x, y) to (u, v), each generator X t transforms according to the chain rule. Let's find 
out how this affects the commutator. Let X 3 = [X ± , X 2 ]; the new accent mark is being used for writing 
the various X t in terms of the new coordinates (u, v). That is in new coordinates (u, v) we have 

x t = {x iU )d u + (x iV )d v . 

Let F(u, v) be an arbitrary function. Then it must be that 

[Xt.X^F = % x {{Xiu)F u + (X 2 v)F v ] - X 2 {{X lU )F u + (X lV )F v } 

= {X 1 X 2 u)F u + (X&vW - (X 2 X lU )F u - (X 2 X lV )F v .= {[X 1 ,X 2 \u)F u + ([X 1 ,X 2 ]v)F v 
= (X 3 u)F u + (X 3 v)F v . 

However, since F is an arbitrary function (meaning the results don't depend on F) we conclude that 

[* 1# * 2 ] = (X 3 u)d u + (X 3 v)d v = X 3 . 

The commutator is therefore independent of the coordinate system in which it is being computed. We 
don't have to distinguish between Zj and X t . 

All of the commuter properties that we have discussed so far have been in terms of 
commutators acting on the plane. The commutators of the prolonged generators 
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x\ k) = tfx + Vd y + v {1) d y > + ■■■ + J? (k) a y(fc ) 

Is defined similarly: [A 1 (fc) ,A 2 (fc) ] = x[ k) X^ k) - X^ k) x[ k \ 

Without loss of generality suppose, for example, that X r = d y , X 2 = %(x,y)d x + rj(x,y)d y . 
(Recall that our choice of coordinates does not affect the commutator.) Then 

[X ± ,X 2 ] = d y ^(x,y)d x + T](x,y)d y ) - (^(x,y)d x + r](x,y)d y )d y = <f y d x + r) y d y = X 3 . 
From the beginning of the chapter, rj^ = (D x r] — y'D x %), the prolongation formula forZ^is 

* 3 (1) = ^yd x + r] y d y + r] w d yl . 

Plugging in to [x^ ,*®] we § et 
[4 3) -4 3) ] = [dy. Zydx + riydy + r] m d yl ] = d y (Sd x + r]d y + rPd y .) - (fd x + rjd y + rPd y ,)d y 

= tyd X + t d xy + Vy d y + V d yy + r ly^ d y' ~ $ d xy ~ ^yy = %y d x + Vy d y + Vy^dy' 

= x?\ 

(In a different approach we could have used the fact that d y and D x commute (D x d y = (d x + y'd y + 
y"d y , + -)d y = d y {d x + y'd y + y" d y < + •••) = d y D x .) Thus [X V X 2 ] = X 3 and [z i (3) ,Z 2 (3) ] = Z 3 (1) . 
The result continues for all k > 1. For k > 1 note that D x 77 y fe_1) - y w D x = d y (D x J7 (k_1) - 
y^D x lf) = r]y k \ these relationships having been developed in earlier parts of this chapter. Thus 
[^ k) ,X 2 (k) ] = Z 3 (k) V k in any coordinate system. 

Now we show that if £ then £ L, otherwise known as closure. With x\ n ^ = 

Zid x + Vi d y + Vi Wd y' + ■■■ + Vi (n)d y (n), we have that ^ (n) y (n) = J?; (n) , all other terms but the last 
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term being zero. Then zf n) (y (n) - &)) = j?; (n) - x\ n) u) = when y (n) - ft) = 0. For n > 2, the 
prolongation formula implies that rj^is linear in the highest derivative, y( n \ whereas ft) and therefore 
X^oj are independent of the y^ n \ The linearized symmetry condition thus implies that x[ n ^{y^ — 

a)) = Aj(y^ -w) where A t (x,y,y yC*" 1 )) = ^y. LetZ= [A^]. Now consider ^(y^ - 

o>) = [z{ n) ,Z 2 (n) ] (y ^ - o>) = ^^(yW - a,) - #(j,(n) - ft,) = jfW (xW( y W - 

ft))) - Z 2 (n) (z{ n) (y W - ft))) = x{ n) A 2 (y ^ - ft)) - X^X^y™ - ft)) = (z{ n) A 2 - A^) (y <"> - 
ft)). Hence x^(y^ — ft)) = when y^ — ft) = 0, and therefore X generates Lie point symmetries. 
The same holds for the case for n = 1, but it's complicated by the fact that rf^ is quadratic in y'. 
Recall: = r\ x + (j] y - $ x )y' - % y y' 2 . So, if X^Xje £ then [X^Xj] £ £ (closure). 

Important (physics) definitions . For n > 2, the set £ is a finite-dimensional vector space. Once 
we pick a basis ... , X R } for £, every generator of Lie point symmetries can be written as a linear 
combination of the generators in the chosen basis: [^;,^/] = cj c jX k , where the cjj are called the 
structure constants . lf[Zj,Z,] = 0, the generators Z;and Zjare said to commute. Clearly, every 
generator commutes with itself. Particle physicists deal with structure constants all the time, but they 
deal primarily with matrix representations of a Lie algebra, not with realizations of the infinitesimal 
generators as we're doing. Now let's get this out of the way. A vector space is defined to have certain 
properties which you can readily look up. If a vector space also has a product (in this case our 
commutator "product" [X, A,] = cfjX k , then this vector space is a Lie algebra . A Lie algebra is a vector 
space that is closed under commutation where commutation is bilinear, antisymmetric, and satisfies the 
Jacobi identity. Antisymmetric means [^;, ^/] = — [-fy-fy] which implies cfj = —cf t . Evidently cf t = so 
we only compute the generators with i < j. The Jacobi identity [X v [X 2 ,X 3 ]] + [X 2 , [X 3 , XJ] + 
[X 3 , [XM] = V i,j, k. It is true iff cf jC l kq + c« k c l iq + c q kl c) q = V i,j, k. 
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Example 2.9 -The Lie algebra of Lie point symmetries of y'" = y~ 3 is two-dimensional, being spanned 
by the basis X ± = d x , X 2 = xd x + ^yd y . Then [X lf X 2 ] = d x (xd x + ^yd y ) — (xd x + ^yd y ) d x = d x + 

3 3 

xd xx + -yd xy — xd xx — -yd xy = d x = X x . Now [X 1 ,X 1 ]=[X 2 ,X 2 ] = 0, and [Z 2 ,XJ = —X x . Thus the 
only nonzero structure constants for the basis are c\ 2 = 1 ar| d c 2i = ~ 1- 

Example 2.10 — In the last example of chapter 1 (Example 1.15) I introduced you to the three- 
dimensional rotation matrices defining the group SO(3), the rotation matrices providing the matrix 
representation of the SO(3). The three matrices form the basis of SO(3). The realization of SO(3) 
came from the basis of quantum mechanical angular momentum operators derived from converting 
their classical mechanics versions to their quantum mechanical versions. The basis for a representation 
or realization of 50(3) are not unique. Here is another representation with basis 

x 1 = (1 0) T , x 2 = (0 1 0) T , x 3 = (0 lY, 
such that x 1 xx 2 = x 3 x 1 xx 3 = — x 2 x 2 x x 3 = x t The only nonzero structure constants are 

C 12 = C 23 = C 31 = 1< C 21 = C 32 = C 13 = — 1- 

(The structure constants are unchanged by a cyclic permutation of the indices (123).) The Lie algebra 
with these structure constants is so(3). The Lie group generated by so(3) is SO(3), the special 
orthogonal group. An alternative realization in terms of generators of Lie point symmetries is 

1 1 

Xi = y d x ~ xd y , X 3 = - (1 + x 2 - y 2 )d x + xyd y , X 3 = xyd x + - (-x 2 + y 2 )d y . 

It follows from previous results that structure constants are unaffected by a change of variables 
or prolongation. HOWEVER, structure constants depend on the choice of basis for £. Life is easier in a 
basis with as few nonzero structure constants as possible . (This reminds me of Gram-Schmidt 
orthonormalization process.) If all the basis vectors of the basis commute, the Lie algebra is abelian. 
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Example 2.11 — (A practice problem) Consider the most general two-dimensional Lie algebra with basis 
{X 1 ,X 2 }. The commutator of Z x with X 2 is of the form [X^^] = c\ 2 X-y + c\ 2 X 2 The Lie algebra is 
abelian iff c\ 2 = c\ 2 = 0. This is also the condition for linear independence: X v X 2 are linearly 
independent if a = b = is the only way to make aX x + bX 2 = 0. If the Lie algebra is not abelian we 
can find another basis [Xl,^ 2 ] sucn that [^1^2] = ( We have shown that our algebra is 
independent of our coordinate basis, so if [X ± , X 2 ] = X x then [X lt X 2 ] = X t ) To compute this other 
basis, note that the commutator of any two generators must be a multiple of c\ 2 X x + c\ 2 X 2 , the most 
general commutator by our construction for Xjand X 2 . Let X x = c\ 2 X x + c\ 2 X 2 Suppose c\ 2 then 

[Z 1( Z 2 ] = [^2^1 + ^12^2,^2] = C 12^1'^2] + c 12\^2'^l\ = C 12^1'^2] = C 12^1'^2] = C 12^1 
1 ~ 1 7 

which is off by a factor of c[ 2 . To fix this, let X 2 = —X 2 . Similarly if c-f 2 ^ but the Lie algebra is non- 

C 12 

abelian, then letting X 2 = — —X 1 would satisfy our = Let's check. 

C 12 

[Z 1( Z 2 ] = [ c 12^1 + C 12^2,^2] = i - [ C 12^1 + C 12^2,^l] = ~ V^l> ^2~\ = %1 ^ C 12 = 1> C 12 = — 1- 

C 12 C 12 

Vector spaces can be built from vector subspaces in various ways and Lie algebras may be built 
from Lie subalgebras. How we join the Lie subalgebras determines the structure constants of our Lie 
algebra. Let [M , J\f ] be the set of all commutators of generators in M c £ with generators J\f c £, 
that is, [M , J\f ] = {[Xi, Xj] : X t £ M , Xj £ N). A subspace M c £ is a subalgebra of a Lie algebra if it's 
closed under commutation, [M,M] c M. A subalgebra M c £ is an ideal if [3f,£]c M. The set {0} 
and £ are both, trivially, subalgebras and ideals. Any other ideal other than the trivial ideal is a proper 
ideal. Facts: every one-dimensional subspace of £ is a subalgebra but not necessarily an ideal as each 
commutator commutes with itself. Almost all Lie algebras of dimension R > 2 have at least one two- 
dimensional subalgebra; the one exception (important to physics) is the simple Lie algebra so(3). 



63 



Example 2.12 — (Another Lie algebra important for physics SL(2). Given the three-dimensional Lie 
algebra X x = d x , X 2 = xd x , X 3 = x 2 d x . The nontrivial (nonzero) commutators of [^£,Ay], i < j are 

[^1,^2] = %i> [^1^3] = 2X 2 , [■^i'^O'] = ^3- 

This Lie algebra is the special linear group sl(2) which generates SL(2). The subalgebras are 
Span(X 1 ,X 2 ) and Span(Z 2 < ^3), which are two-dimensional. Span(Z 2 <^3) is not closed. Hence it's not a 
subalgebra. The group sl(2) has only the trivial ideals. Note— In later work we use groups (with only 
one binary operation) to study structure constants versus ideals (with two binary operations). 

Important : Given any Lie algebra £, one ideal that can always be constructed is the derived 
subalgebra £ (1) , which is defined by £ (1) = [£,£]. Of course [£ (1) ,£] c making £ (1) an ideal of 
£. If £^ £, we may continue to find the derived subalgebra of £^ via £® = [£^,£^], ... , 
£(k) _ j£(k-i) ; £(k-i) j unt j| we obtain no new subalgebra. If for some k we get £^ = {0}, then £ is 
said to be solvable. Given R point symmetries of and ODE, an i?-dimensional Lie algebra is solvable if 
there is a chain subalgebras such that {0} = £ c £ x c ••• c £ R = £, where dim(£ fe ) = k, such that 
£fc_! is an ideal of £ k for each k. Seen from several previous examples we now see any non-abelian 
two-dimensional Lie algebra has a basis such that [Z 1( Z 2 ] = X v and hence is solvable. For each R > 3 
there exit lie algebras that are not solvable, e.g., so(3). 

Important : Given an i?-dimensional solvable Lie algebra, it's best to choose a basis such that 

%k = ^k> %k ^ £k-l> k = 1, ...,R. 

Hence £ k = Span^, ... , X k ). This basis is the canonical basis . Equivalently, a basis is canonical if 
cf; = V i < j < k. 
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Example 1.13 — Recall this example? Given y^ =y'"*, the linearized symmetry condition leads to the 
following set of infinitesimal generators: X x = dy, X 2 = xdy, X 3 = x 2 dy, X 4 = dx, X 5 = xdx, leading 
to a five-dimensional Lie algebra £ = {X 1 ,X 2 ,X 3 ,X 4 ,X 5 }. From all possible commutators taken from the 
set {X 1 ,X 2 ,X 3 ,X 4 ,X 5 } we only get back the infinitesimal generators {X 1 ,X 2 ,X 3 ,X 4 }. There is no 

= c ■ X 5 where c is nonzero. We say that the infinitesimal generators {X 1 ,X 2 ,X 3 ,X 4 ,X 5 } form a 
derived subalgebra = span^,^^^) under the (binary) operation of commutation. Now by 
taking all possible commutators from the set {X 1 ,X 2 ,X 3 ,X 4 } you only get back two infinitesimal 
generators, namely, £® = span^,^}- Repeating this using all possible commutators from {X 1 ,X 2 }, 
you get £® = {0}. We conclude that £ is solvable. 

Finally we get to stepwise integration of ODEs (as to when this is possible at least in principle). 
We know that given and ODE of order R that has an R -dimensional Lie algebra L, we may rewrite the 
ODE in terms of differential invariants as 

v R = F(r R ) 

for some function/ 7 . When can we solve the ODE by using each symmetry generator in turn? (As we 
proceed, we assume that generators are sufficiently prolonged to describe the linearized group action 
on all variables.) 

Suppose that the generators X Xl ...,X R _ X form a subalgebra of £. Let (r R _ 1 , be the 
fundamental differential invariants of this subalgebra. If the remaining generator X R acts on 
(r R _ 1 , as a generator of point transformations, there exist canonical coordinates 

(Tr> S r) = ( r i?( r R-l< 1; R-l)< S R( r R-l< 1; R-l))< 
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as every noninvariant "point" in terms of which X R = d s . (We can find (r R , s R ) by methods we've done 



which is invariant under the group generated by X lt ... , If this equation can be solved for v R _ x , 

we get a problem of the form v R _ x = F(r R _ 1 ). Provided we can iterate this procedure sufficiently many 
times, we will obtain the general solution of the ODE. This is so iff £ is solvable. 

Proof: Clearly X R acts on r R (r R _ 1 , as a generator of point transformations if the 
restriction of X R to the variables (r R _ 1 , v R _{) is of the form 

X R = air^v^-Jdr^ + /?(?«_!, i^-iK^ 

for some functions a, /?, at least one of which is nonzero. Thus we require that 

Xr T R-1 = a ( r R-l> V R-l)> ^R V R-li r R-l> V R-l)- 

The differential invariants r R _ 1 , v R _ x satisfy 

X(r R _ x = 0, XrVr-! = V i = 1 R-l, 



in the examples.) The v R is a function of r R and s R = G(r R ) for some function G. Hence we obtain 




and hence 



[Xi,X R ] = XiCtir^.v^) = 0, Vi = 1 R-l. 



We may rewrite this as 



cf R X k r R _ 1 = 0, Vi = l R-l, 



leading to 



Vi 



i = 1, 



R-l, 
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By a similar argument, [Zj, X R ] v R _ x = leads to 

cfzptrn-i, v R -t) = 0, V i = 1 R-l, 

Therefore, since at least one a, /3 is nonzero, 

cSt = 0, Vi = l 

Span(Z 1( ... , is a subalgebra if 

eg = 0, Vl<i<]<fi-1. 

So ... , Z R acts as a generator of point transformations on (r R _ 1 , iff 

eg = 0, V 1 < i < j < R. 

This condition enables us to reduce the order once. Similarly, a second reduction of order is possible if 

eg -1 = 0, V 1 < i < j < R - 1. 

Continuing in this way, each generator X k may be used to carry out one integration if 

eg = 0, V 1 < i < j < k. 

This is only satisfied (in any canonical basis iff £ is solvable. This also works for R > n provided that £ 
has an n-dimensional solvable algebra (see Hydon text chapter 6 for examples). 

IMPORTANT : The following material is on the classification of invariant solutions and the 
classification of discrete symmetries. The latter material (which you should at least peruse if you're 
pressing on to working more PDEs with symmetry methods) is of foundational importance to students of 
particles and fields, which is typically presented to students without any connection to differential 
equations, and usually by uninformed lecturers and dismal, dry, confusing books. In this section you will 
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with study the classification of invariant solutions and the classification of discrete symmetries in terms 
of realizations. Several chapters further on will carefully build up the parallel material in terms of matrix 
representations with, naturally, plenty of step-by-step examples. I don't think that one can be a 
complete physicist, applied or theoretical, without this much broader picture of symmetry methods. 
This stuff underlies many of the "invariants" that are just given to you in text books and by lecturers. It 
also underlies the very mathematics that you will use during your one year studies in graduate quantum 
physics, not to mention quantum field theories. The applications of these methods, in fact, go to all 
physics. 

On the Classification of Invariant Solutions. Two invariant solutions are equivalent if one can 
be mapped to the other by a point symmetry of the PDE (the same methods we have developed for 
ODEs are extended to PDEs in the next chapter which goes back to applications). The set of all invariant 
solutions of a given differential equation belong to the same equivalence class. Classification of 
invariant solutions greatly simplifies the search for invariant solutions. 

In chapter 1 there was a section dedicated to the characteristic equation with an example 
applied to the Riccati equation. I used the characteristic equation again in example 1.9. Let's go 
through one more ODE example, but this time with multiple generators to find invariant solutions. Then 
let's go through an example for a PDE so that we are fresh when we study the classification of invariant 
solutions. 

Many ODEs can't be completely solved using their Lie point symmetries. We still may be able to 
derive solutions that are invariant under the group generated by a particular generator X. Recall from 
chapter 1 that every curve C on the (x, y) plane that is invariant under the group generated by X 
satisfies Q(x,y,y') = rj — = on C. The results that we derive from this equation need to be 
substituted into the ODE to check if they are indeed solutions (invariant solutions). 
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Example 2.13 — The Blasius equation is y'" = —yy" (so many ways to get invariant solutions— ouch.) 
By application of the linearized symmetry conditions we get the translational symmetry X x = d x and the 
scaling symmetry X 2 = xd x — yd y . We may use these symmetries to reduce the order of this ODE to a 
first order ODE (whose solution is not known). Here we concentrate on finding the invariant solutions 
using the characteristic equation. Beginning with X = X ± , with rj = and £ = 1, the characteristic 
equation Q(x,y,y') = rj — y'% = becomes Q(x,y,y') = —y' = 0. The solution to this is y = c, 
where c is an arbitrary constant. Plugging in y = c into the Blasius equation shows that y = c is indeed 
a solution (an invariant curve actually). Now using the other generator X 2 we have r\ = — y and f = x. 
So our characteristic equation is 77 — y'£ = — y — xy' = 0. The solution to this equation is y = c/x (this 
is the candidate invariant curve). Plugging in our candidate solution into the Blasius equation yields 

y'" = — — = —yy" = — y • Solving for y gives us y = 3/x. This is a solution and invariant curve of 

the Blasius equation. This was a good review, but we are not quite done. We haven't fully considered 
all of the possible one-parameter groups. Every remaining one-parameter Lie group is generated by 
X = kX x + X 2 (a linear combination of X Xl X 2 where k is a nonzero constant. In this case r\ = — y but 
f = 1 + k. ( We didn't look at any potentially remaining Lie point symmetries in our examples in chapter 
1 or 2 (go back and do so if you wish). So now our characteristic equation becomes Q(x,y,y') = — y — 

(1 + k)y' = 0. One solution is y = 0. Another solution is y = — -. I hope the use of X = kX x + X 2 

X~\~fC 

helps motivate why we cared so much about the vector space/Lie algebra of the Lie point symmetries of 
an ODE in our recent sections. Here comes more intuitive meaning of infinitesimal generators which we 
did cover in chapter 1, but you might have forgotten about. For X Xl we know the tangent vector 
components are 



(dx\ 



£=0 




£=0 



= 0, s £ R. 
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By inspection we can readily see that x = x + s and y = y. Hence the action of Z x on y = 3/x is to 
produce y = 3/(x — s), which is invariant under X 2 = {X 2 x)d x + {X 2 y)d y = ((xd x — 3 y )(x + 

£ )) d% + {{xd x — yd y )y) d y = xd x — yd y = (x — s)d x — yd$. Let us know introduce a very useful 
notation; ifZj = % t (x,y~)d x + r]i(x,y)d y , then let 

Notice then that y = 3/(x — s) is invariant under X 2 = X 2 — eX-^. Dropping carets, y = 3/xmaps to 
y = 3/(x — e), which is invariant under X 2 — eX^ A similar calculation shows that y = is mapped to 
itself under X x . 

The invariant canonical coordinate r(x,y)satisfies %D x r + Qr y = %r x + r]r y = 0, so every 
invariant solution on which f is of the form r(x,y) = c. There may also be invariant solutions 

y = f( x ) sucn tnat ^( x </W) = ^(.X'fix)) = 0- 

Generally speaking, these solutions are gotten by solving either ^ (x, y) = or rj(x, y) = 0, then 
checking (by substitution) that the solutions indeed satisfy the ODE and ^(x,/(x)) = ?j(x,/(x)) = 0. 
There is yet another way to find invariant solutions on which ^ does not vanish which is useful if the 
characteristic equation is hard to solve (recall the second example of chapter 1). For Lie point 
symmetries f and rj are functions of x and y only. Clearly then the characteristic equation holds if 

y ~ax,y) 

on invariant curves for which ^ is not zero. Higher derivatives are calculated by the prolongation 
formula. (See example 4.7 Hydon text). Can you begin to see why classification of solutions in terms of 
equivalence relations might be a good idea? 
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A note on symmetry methods for PDEs. The detailed material for symmetry methods for PDEs 
lays ahead in a later chapter. Suffice it to say for now that every concept we have developed for ODEs 
extends to PDEs. Namely, we search for Lie point symmetries via the linearized symmetry condition. 
With the symmetries in hand we may, as we just did in the previous example, then look for invariant 
solutions. We may, additionally, try to reduce the order of our PDE, rely on various ansatze, etcetera. 
As for invariant solutions, we have the same proliferation issue as we do with ODEs. 

Equivalence of Invariant Solutions (general discussion). Two invariant solutions are equivalent 

if one can be mapped to the other by a point symmetry of the ODE or PDE. Equivalent solutions belong 
to the same equivalence class. Classification of invariant solutions into equivalence classes greatly 
simplifies the problem of determining all invariant solutions. To keep things simple, let's restrict 
ourselves to the problem of the equivalence of solutions that are invariant under a one-parameter Lie 
group of point symmetries, and to avoid too much clutter, let x and u denote the ^independent and 
Mdependent variables respectively, and let z be the set of all variables, z = (x, u). Let 

T-.z^z (38) 
be a symmetry that acts on a solution that is invariant under the one-parameter group generated by 
X = K l Xi where each k 1 is a constant, and the generators X t = <"f (z)d z s form a basis for the Lie 
algebra. Let a carat over a function indicate that we have changed z by z. Then, for example, 
X t = <"f {z)d~s is the same function as before, but with the new argument. 

Having just worked example 2.13, we should be fresh on the procedure for generating invariant 
solutions. Suppose u = f(x) is invariant under X. In terms of (x, u) we have u = /(x). The symmetry 
generator X can also be written in terms of (x, u), then we may remove the carats. In the transformed 
coordinates, u = /(x) is invariant under the generator X. By our construction, u and u are equivalent 
and X and X because a symmetry, T maps one to the other respectively. To classify invariant solutions 



we will classifying the associated symmetry generators. When this is done, one generator from each 
equivalence class may be used to obtain the invariant solutions. A set containing exactly one generator 
from each class is an optimal system of generators. 

To classify generators we write X in terms of z. Instead of asking you to recall from chapter 1 
that (where F is any smooth function and z = e £X >z) 

e £X iF{z) = F(e £X iz) = F{z), 

I'll just cut and paste the brief material here: 

How is the infinitesimal generator affected by a change of coordinates? Suppose (u, v) are new 
coordinates and let F(u, v) be an arbitrary smooth function. By the chain rule 



XF(u,v) = XF(u(x,y),v(x,y)) = %{x,y)d x F + rj{x,y)d y F 



dF du dF dv 
du dx dv dx 
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dF du dF dv 
du dy dv dy 



= Z[u x F u + v x F v ] + r][u y F u + v y F v ] 



= {^u x + T]u y )F u + {^v x + nv y )F v = (Xu)F u + (Xv)F v . 
Without loss of generality, since F(u, v) is arbitrary, in the new coordinates 

X = {Xu) d u + (Xv)d v , 

Thus X represents the tangent vector field in all coordinate systems. If we regard {d x , d y ) as a basis for 
the space of vector fields on the plane, X is the tangent vector at (x, y). The infinitesimal generator 
provides a coordinate free way of characterizing the action of Lie symmetries on functions. 

If (u, v) = (r, s) are canonical coordinates, the tangent vector is (0,1) and X = d s . Let 
G(r(x,y),s(x,y)) be a smooth function and F(x,y) = G(r(x,y),s(x,y)). At any invariant point 
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(x,y), the Lie symmetries map F(x,y) to F(x,y) = G(f, s) = G(r, s + s). Applying Taylor's theorem 
and given X = d s , we get 

oo oo 

7=0 j=o 

E i 

Reverting back to (x,y) coordinates, F(x,y) = Y,f =0 —X } F( x ,y)- If the series converges it is called the 

Lie series of F about (s, y). We have assumed that (s, y) is not an invariant point, but the expansion is 
also valid at all invariant points. At an invariant point X = 0, and only the j = term survives, which is 
F(x,y). We may express all of this in shorthand to F(x,y) = F(e EX x, e £X y) = e £X F{x,y). 

If z = e^z and F is any smooth function, we rewrite X in terms of z. 

e eX iF(z) = F(e £X iz) = F(z), 

More generally we define the action of any symmetry r: z —* z on any smooth function F similarly 

TF(z) = F(Tz) = F(z) (39) 
This will allow us to deal with discrete symmetries as well as Lie point symmetries. Now let r(<5) denote 
the one-parameter Lie group of symmetries generated by X where S is the group parameter and 
T(<5): z — » e 5x z. If F is an arbitrary smooth function, then from (39), F(z) = r _1 F(z), so multiplying 
both sides by TX produces TZF(z) = TXr~ 1 F(z), but XF(z) = F(z), so the equation above becomes 

tf(z) = txf(z) = rzr _1 F(z). 

By looking at the last term of the equation above us it seems that 

X = TXT' 1 . (40) 

xf(z) = tzf(z) = rzr _1 F(z). 
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So what is XXF(z) = X 2 F(z)? (This math here is very present in quantum physics and field theories.) 

x 2 f(z) = rxr _1 (rxr _1 F(f)) = rxr -1 r^r -1 F(f) = rjr 2 r -1 F(f). 

Continuing on and assuming convergence we can form the Lie series f (<5)F(z) = e Sx F(z) = 
Ye Sx Y~ 1 F(z) = rr(5)r _1 F(z). Now since F is arbitrary, it must be that rzr _1 is the generator of the 
one-parameter Lie group of symmetries f (<5) = IT(<5)r _1 . We will use this result when we get to 
classifying the discrete symmetries of a differential equation. 

(Now for getting particular) In this section we ignore generators that depend on arbitrary 
functions, such as the infinite dimensional subalgebras that occur in linear or linearizable PDEs. To study 
the equivalence problem we restrict ourselves to Lie symmetries generated by a finite-dimensional Lie 
algebra with basis {X lt ... , X R }. In this case it can be shown that the equivalence problem is solvable by 
studying a finite sequence of one-dimensional problems. In each of these problems, we look at the 
equivalence under the symmetries obtained from one of the generators in the basis, 



for any generator X. (Here, and in the rest of this section we don't sum over the index j as Xj denotes a 
specific generator.) In particular, (42) holds for X = Xj, which commutes with e~ eX >; thus 



Y: z — > z = 



(41) 



From (40) 



X = e £X iXe~ £X i 



(42) 




(43) 



We can now write any generator X in terms of z by solving (42) for X using (43) to obtain 



X = e- £X iXe- £X i. 



(44) 
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The RHS of (44) generates a one-parameter symmetry group under which u = /(x) is invariant under 
the group generated by 

X = e - £X iXe- £X i. (45) 
which is equivalent to X (under this similarity transformation). This holds for all Lie point symmetry 
generators Xj. Essentially, the classification problem for generators is solved by using equation (45) with 
the various generators Xj in turn, to reduce every such generator to its simplest form. How we do this is 
what comes up next: theory followed by examples. 

(More quantum physics and quantum field theory math) The equivalence relation (45) involves 
symmetry generators, rather than any particular solutions of any particular differential equation. Once 
we've classified the generators for a particular Lie algebra, the classification results apply to all 
differential equations (ODEs or PDEs) with that Lie algebra. (Here is where a historical divorce happened 
between Lie algebras and differential equations. You can study these two subjects apart, as we do 
today, to your great detriment.) Identifying all possible Lie algebras has been solved for scalar ODEs, not 
for PDEs or systems of ODEs. We usually need to do classification work on a case-by-case basis. 

From (45), X satisfies the initial value problem (just do it) 



'dX\ &X , _ BY .„ _ cyA „„ . „„ r „ ^ „ (46) 

£=0 

Repeating the differentiation gives us 



d 2 X 
~dez 



dX 
X i'~di 



= (-l) 2 [Xj,[X J ,X]] l 



and so on. Taylor's theorem then leads to the following series solution (valid for all e sufficiently near 



zero 
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X = X-e[Xj,X] + -[Xj,[X p X]]---, 
If X and Xj commute, then (47) reduces to X = X V a. 

For abelian Lie algebras, all generators commute, so no two linearly independent generators are 
equivalent. The optimal system of generators contains every generator. For non-abelian Lie algebras 
that occur in quantum physics, the noncommuting generators are not linearly independent— being 
"entangled"— the underlying time and space being relativistically "entangled", in turn also "entangling" 
internal symmetries in quantum field theories. <L Is entanglement evidence of higher dimensions? 

For non-abelian Lie algebras, we will use each basis generator Xjto simplify X by eliminating as 
many of the constants k 1 as possible in X = K l X t . Note that we have the freedom to multiply X by a 
nonzero constant A. (The group generated by AX is the same as the one generated by X.) This 
multiplication by A, causing rescaling, will allow us to make simplifications. 

Example 2.14 — Consider the non-abelian two-dimensional Lie algebra with basis {X 1 ,X 2 } such that 
\Xi, X 2 ] = X x . This is the Lie algebra a(l). Each generator is of the form 

X = K 1 X 1 + K 2 X 2 . 

Let's find out which generators are equivalent to X under the group generated by X r by plugging into 
the Lie series (47). 

s 2 

X = X-e[X 1 ,X]+-[X 1 ,[X 1 ,X]]-- 

s 2 

= K 1 X 1 + K 2 X 2 -S[X 1 ,K 1 X 1 + K 2 X 2 ] + — [X 1 ,[X 1 ,K 1 X 1 + K 2 X 2 ]]~... 

S 2 

= K 1 X 1 + K 2 X 2 - £K 2 [Z 1; Z 2 ] + — [X lt K 2 X 2 ]] - - = K 1 X 1 + K 2 X 2 - SK 2 X 1 
= (K 1 - £K 2 )X 1 + K 2 X 2 . 
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The second order term and higher order terms are all zero. If our goal is to simplify (reduce the number 
of constants k 1 by as much as possible), let's suppose that k 2 0. Then if we choose s = k 1 /k 2 , then 
X is equivalent to k 2 X 2 . We may rescale k 2 to one WLOG. The remaining possibility is that k 2 = 0. 
Then X = k x X x , which reduces to X = X x after we rescale k 1 to one WLOG. So for our Lie algebra a(l), 
the set {X 1 ,X 2 } is an optimal system of generators. That is, every solution that is invariant under a one- 
parameter group generated by X\s equivalent to a solution that is invariant under the group generated 
by one of the generators in the optimal system. 

We began with by using X x to solve the equivalence problem. What if we had used X 2 ? Then, 

s 2 

X = X-s[X 2 ,X]+-[X 2 ,[X 2 ,X]]-- 

s 2 

= K 1 X 1 + K 2 X 2 - S[X 2 , K 1 X 1 + K 2 X 2 ] + — [X 2 , [X 2 , K 1 X 1 + K 2 X 2 ]]~. . . 

e 2 

= + K 2 X 2 - EK^XM + — [X 2 , [X 2< - - 

E 2 

= K X X X + K 2 X 2 + £K 1 X 1 - "^-K 1 *! + ••• = e E K 1 X 1 + K 2 X 2 . 

So X 2 acts on the group by rescaling the ^component. If k 2 =t 0, we rescale X and set k 2 = 1 WLOG. 
If k 1 also, let e = — ln| k: 1 | . With this rescaling work done the simplest we can make X is 
X = +X-L + X 2 . We can't reach X = X 2 without using X ± . 

Typically we use most if not all of the one-parameter groups e £X ito produce an optimal system 
of generators. While the calculations are not bad for low dimensional problems, the complexity of the 
calculations increases rapidly with increasing dimensionality. This is what motivates a move to matrix 
methods (amenable to manipulation by linear algebra packages). In terms of components we have 

X = K l X it (48) 
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X = K % = K^-^iX^-^i. (49) 
Each of the Xi can be written as linear combinations of the X m . This is efficiently expressed in matrix 
form by 



X i = (A(j,e))™X m 
for some Rx R matrix A(J, s). Let k m = k 1 (A(J, g))™. Then 

X = ii m X m . (51) 

Let us introduce the following row vectors 

k = (k 1 , ...,k r ), 
k = (k 1 , ...,k r ). 

Then T may be regarded as a mapping that acts on the constants k as T: k — » k = Kj4(/, £). Since 
= e- £X ;Z;e- £X ; we have^J = -e- £X \X ]t X^e £X i = c£(X £ ) g=0 = Z*. Then from equation (50) 

d(40»r m m (52) 

d£ - *m = 4j(A(j, a))] X m , (A(j, 0)). X m = X h 
Let's rewrite the structure constants themselves in terms of a matrix 

mt = 4 

Then, 

d ^X m = C(j)A(j;s). A(j,0) = I, (53) 
where / is the identity matrix. The general solution of (53) is 



(50) 



78 



" £ n (54) 

A{j,8) = e £C ^ = 2^C{ir- 



71=0 

Sometimes you may solve (54) by hand, but sometimes you may need a computer algebra system. 

As we know, the generators of abelian Lie algebras cannot be simplified at all because each 
generator is invariant under the group generated by any other one \X b Xj] = 0. Some non-abelian Lie 
algebras may also have one or more invariants, I{k), where k is the vector from X = K l X t such that 

/( Ke £CC0 =tc) = I( K A(j, e) = k) = I(k), V k, s. (55) 
tHuh? In English please! If I place a meter stick in an orthogonal x, y, z-coordinate system its length 
Ax 2 + Ay 2 + Az 2 = lm. In any other x' , y ' , z'-coordinate system gotten to via some general matrix 

2 2 2 

transformation that preserves length, it better be that Ax' + Ay' + Az' = lm. Clearly this places 
restrictions on the matrices which transform (x, y, z) to (x', y ', z'). In this example we require our 
transformation matrix to have determinant +1 for example. 

Mathematically, these invariants I{k) act as constraints on the amount of simplification that is 
possible, so it is important to be able to derive them systematically. To the physicist, these invariants 
are loaded with physical meaning, e.g., eigenvalues to differential equations. Differentiating (55) wrt e 
at e = results in both the necessary and sufficient condition for I(k) to be invariant: 

kC(j)VI(.k) = 0, Vj, (56) 

where (the matrix PDE) is given by 



v/oo = 



r ( ^ - 5I(K) 



The invariance conditions (55) can be solved using the method of characteristics. Here comes a 
little more linear algebra. We may rewrite (56) as 
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K(k)VI(k) = 0, (57) 
where K(k) is the R x R matrix whose / h row is kC(j). The matrix PDE (57) can be simplified by 
reducing K(k) to echelon form; the resulting equations sometimes being readily solvable by the method 
of characteristics. If p = Rank(if(X)), there are R — r functionally independent invariants. 

Example 2.15 — Let's use the matrix method to determine an optimal system of generators for the three- 
dimensional Lie algebra sl(2). Say we start off with the basis {X 1 ,X 2 ,X 3 } such that 

[^l'^] = %i> [X11X3] = 2^2< [^2^3] = -^3- 

What is our goal? This example will have lots of algebraic manipulations. Let's first look at our goal. If 
you recall our examples, we've used the linearized symmetry condition on differential equations to 
extract their infinitesimal generators {X 1 ,X 2 ,X 3 }, which form a Lie algebra. With these generators we 
proceeded to crank out invariant solutions. Unless {X 1 ,X 2 ,X 3 } is an optimal system of generators, some 
invariant solutions may turn out to be invariant to a messy, as yet unknown combination of the X t . We 
have seen this in an example 2.13 with X = kX 1 + X 2 . To avoid this, our goal is to transform 
{X 1 ,X 2 ,X 3 } to an optimal system of generators {X 1 ,X 2 ,X 3 } so that every solution that is invariant under 
a one-parameter group generated by X = /c'Zjis equivalent to precisely one of theZj of the optimal 
system. In net then, all of the solutions fall into equivalence classes, one equivalence class for each X t . 
Having done this, one generator from each equivalence class [Zj is used to obtain the desired set of 
invariant solutions. When the dust has settled, this example will be very enlightening to physicist and 
mathematician alike. 

Right now we sit with X = k x X x + k 2 X 2 + k 3 X 3 . We are looking for the optimal version 
X = k 1 ^ + k 2 X 2 + ic 3 X 3 where X is a linear combination of the old basis generators X = K m X m with 
the K m being as simple as possible. Let's label the "old" structure constants by using [X,^/] = cfjX k . In 
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the first case we have c\ 2 = 1, c\± = — 1. Then we have c 2 3 = 2, c\ x = —2. In the third case we have 
c| 3 = 1, c| 2 = — 1. For j = 1 we have C21 = — 1 and c| x = —2. WARNING: Since j is fixed, evidently 

the elements of the matrix (C(y = 1))^ depend not, as usual on i,y, but on i, k. Look at the first part of 
equation (52), - X m = cfj{A(j, e))™X m to convince yourself. So plugging into (C(y = 1))^ = 



cf j=1 we get (CO' = l))^ 1 = -1 and (C(j = l))" 



,k=2 



= -2 



C(j = 1) = 





-100 

-2 



For j = 2 we have c\ 2 = 1 and c| 2 = — 1. We get (C(j = 2))^^ = 1 and (C(j = 2))^_ 



>fe=3 

=3 



= -1. 



CO' = 2) = 



10 

L0 -1 



For j = 3 we have c x 2 3 = 2 and c| 3 = 1. We get (C(J = 3))^ = 2 and (C(j = 3))^ = 1 



,fe = 3 



CO = 3) = 



2 
1 




According to (54) A(j, s) = e EC ^ = 2n=o C(j) n . Starting with j = 1, what is e £C «? 



,£C(1) 



1 





0- 










0" 


s 2 











2 e * 








0- 





1 







-1 








+ 2! 


-1 








+ 3! 


-1 








.0 





1. 


. 


-2 


0. 


. 


-2 


0. 


. 


-2 


0. 



+ 



"1 





0" 










0" 


s 2 


"0 





0" 


s 3 


"0 





0" 





1 





+ 1! 


-1 








+ 2! 











+ 3! 











.0 





1. 


. 


-2 


0. 


.2 





0. 


.0 





0. 



The matrix Taylor series terms become the zero matrix for all terms cubic and higher. Thus 
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AO-.e) = 



1 

— £ 





1 
-2s 1 



Similarly, 



A(2,e) = 



e £ 










"1 


2s 


s 2 





1 





A(3,e) = 





1 


s 


.0 





e~ £ . 




.0 





1 



Let's look for row vectors kC(j) to check for the existence of invariants. Let' start with kC(1) 



[k 1 k 2 k 3 ] 




-10 
0-2 



= [-k 2 -2k 3 0]. 



For j = 2, 



[k 1 k 2 



k 3 ] 



10 

0-1 



= [k 1 -K 3 l 



For j = 3, 



[k 1 k 2 k 3 ] " 



2 
1 




= [0 2k 1 k 2 ]. 



So any invariants satisfy 



-K 2 


-2k 3 







'/iW 







K 1 





— K 3 














2k 1 


K 2 \ 




/ 3 oo 




.0. 



Note that p = 2, so there is only R — r = 3 — 2 = 1 invariant. Recall from linear algebra the eigenvalue 
problem Ax = Ax is solved by finding the roots of the characteristic equation 



Det 



a nl ' " ' a nn ~ 



= 0. 
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This means finding the roots of Det 



-k 2 -A -2k 3 











-A -k 3 
2k 1 k 2 -A. 



= 0, or A 2 - {k 2 Y + \k x k 3 = 0. So 



our only invariant for sl(2) is / = (k 2 ) 2 — 4k 1 k 3 . (If you're rusty, look this up in a sophomore linear 
algebra text.) So what the hell is / = (k 2 ) 2 — Ak 1 k 3 ~> It is our invariant "meter stick" in our 
"coordinate system" . The only way we can affect / is by rescaling X, which is equivalent to 

multiplying k by a nonzero constant. Since / is quadratic in the components of k, rescaling can only 
multiply / by a positive constant. Thus we must consider three distinct problems: / > 0, / < 0, 7 = 0. 

The vector k is transformed by the matrices A(j, s) as follows: 



[k 1 k 2 k 3 ] 



10 

-£ 1 

£ 



2 -2s 1 



= [K 1 - £K 2 + S 2 K 3 K 2 -2£K 3 K 3 l for 4(1, f). 



What the hell is [k 1 — sk 2 + s 2 k 3 k 2 — 2sk 3 k 3 V It is a new, transformed coordinate system with 

K 1 = K 1 — SK 2 + £ 2 K 3 , K 2 = K 2 — 2£K 3 , K 3 = K 3 , (A) 

and in this new coordinate system I A = (k 2 ) 2 — Ak^k 3 , and 7 = I A . No way dudes. Let's check it out. 
(fC 2 ) 2 - 4fC 1 K 3 = (k 2 - 2sk 3 ) 2 - 4(k 1 - sk 2 + e 2 k 3 )k 3 . 

If you do the algebra, indeed 7 = l A , a meter length in one coordinate system is a meter length in 
another coordinate system. Let's press to A{2, e). 



[k 1 k 2 k 3 ] 



e E 
10 
e~ E 



= [e e K 1 k 2 e- £ K 3 l iorA(2,e). 



This is another a new, transformed coordinate system with 



~1 £ 1 ~2 2 ~3 — £ 3 



(B) 



and in this new coordinate system I B = (k 2 ) 2 — 4k 1 k 3 = 7. Very cool. Let's press to A(3, s) 
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[k 1 k 2 k 3 ] 



1 2£ £ 2 
1 £ 

1 



= [k 1 2SK 1 + k 2 e 2 ^ + £K 2 + k 3 ], for A(3, e). 



This is our third new, transformed coordinate system with 

K 1 = K 1 , K 2 = 2£K 1 + K 2 , K 3 = £ 2 K X + £K 2 + K 3 , (C) 

and in this new coordinate system I c = {it 2 ) 2 — 4/c 1 k 3 = /. Very cool yet again. 

Now our task is to use the fact that in the original coordinate system, (A), (B), and (C) we have 

/ = (k 2 ) 2 - \ K ^ K ?> = I A = (k 2 - 2ek 3 Y - 40c 1 - £K 2 + s 2 k 3 )k 3 = I B = (k 2 ) 2 - 4e £ K 1 ■ e~ E K 3 

= I C = {2EK 1 + K 2 ) 2 - 4K 1 ■ ^K 1 + £K 2 + K 3 ) 

to simply out an optimal systems of generators. 

Now suppose / > 0. The first and third components of vector (A) involve the parameter e in 
addition to the set {k 1 , k 2 , k 3 }. We are looking to find the simplest form of vector (A) and we have the 
freedom to play with e. Suppose k 3 and look at the first component of vector (A), k 1 — ek 2 + e 2 k 3 . 
What does e have to be so that the first component of vector (A) is zero. To ask this is to solve for e in 
the quadratic equation e 2 k 3 — ek 2 + k 1 = 0. Rearranging leads to 



, K 2 K X 
E 2 -—£ + — = 



K 3 K 3 



The quadratic formula leads to 



K 2 \(k 2 \ 2 Kl K 2 1 r—— — K 2 V7 

2k s J\k/ k 3 2k a 2k s 2k a 2k s 



Pick the positive root to let 

k 2 + V7 



£ = 



2k} 
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So now with s as selected, vector (A) is reduced to 

K 1 = 0, K 2 = K 2 — 2SK 3 , K 3 = K 3 . 

If instead it happened that k 3 = without saying anything about k 1 , then let s = k 1 /k 2 . This leaves us 
vector (A) looking like if k 3 0: 

k 1 = 0, k 2 = k 2 , k 3 = 0. 
We may rescale k 2 = 1 to get vector (0,1,0). So from equation (50), X t = {A(J, e))!™ Z m , 

one of our optimal system of generators is X 2 = X 3 . We have two more to go. 

Let us suppose / < 0. In our original coordinate system this would mean that k 1 ^ 3 > 0. Let's 
study vector (A). Let s = k 2 /2 k 3 . Then vector (A) reduces to 

K 1 = K 1 — SK 2 + £ 2 K 3 , K 2 =0, K 3 = K 3 . 

The k 2 term has been disappeared. Then in vector (B) let s = ^ln^-. Then vector (B) becomes 

K = Jk 3 Y' k =0 ' k = Jk 3 Y' 

WLOG let k 1 = k 3 = 1. Then vector (B) becomes (1,0,1). So from equation (50), X t = (A(j, e))™ X m , 
one of our optimal system of generators is X r + X 3 . One more to go. 

If / = then either all three components of the vector k are zero, or k 2 and either of k\ k 3 are 
zero. Now a property of the matrices which go with the invariant / is that 

[k 1 k 2 k*\-\\a<S,e), 
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retains the invariant /, where fl s) is any product of A(i, s) with s any constant. Suppose 
k 1 , k 2 = 0. Then vector (C) becomes 



k 1 = 0, k 2 = 0, k 3 = K 3 . 
One of our optimal generators already includes the third component. Now 
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= (k 3 0), 

so we can replace the second and third components of any k with zeros. We may rescale k 3 = 1 to get 
(1 0). Thus our last optimal generator is X v 

Our optimal set of generators are {X 1 ,X 2 ,X 1 + X 3 } for sl(2). The optimal set of generators 
contains every generator. Each generator of the optimal set may now be used to obtain the desired set 
of invariant solutions for any ODE or PDE with Lie algebra sl(2). Don't get the wrong impression from 
the previous two examples where the number of generators coincides with the dimension R of the Lie 
algebra. Quite commonly the number of inequivalent generators exceeds R. 

We have looked at building an optimal set of generators quite divorced from differential 
equations. We can proceed to calculate the associated invariant solutions of an ODE or PDE with a given 
optimal set of generators to derive an optimal system of invariant solutions, but we potentially face 
two obstacles. First of all the generator in the optimal system might not yield any invariant solutions. 

Example 2.16 — Consider y" = y ~ 3 . Application of the linearized symmetry condition would lead to the 
following Lie point symmetries 

1 

x i = d x> x 2 = xd x + 2 yd v Z 3 =x2d x + x V d y 
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If you repeat the work of example 2.15 you will find that these infinitesimal generators have the Lie 
algebra sl(2). The optimal system of generators is {X 1 ,X 2 , X x + X 3 }. Alas no solution is invariant under 
the group generated by X v From X x we see that f = 1 and rj = 0, so dy/ dx = 0, so y = c, where c is 
an arbitrary constant. We need to check if y = c is a solution to our ODE. Nope. The 2 nd derivative of a 

constant is zero. The same applies to the group generated by X 2 . In this case ^ = x and r\ = -y, so 

dy/dx = y/2x, so y = cyfx. We need to substitute this result into our ODE to see if it is a solution. 

LH S:y" = -i-^3 = RHS = ^4. 

X 2 X 2 

The only way to make this work if it happens to be that c 4 = —4. This means c is not real. So there are 

~ i 

no real-valued solutions for X 2 . For X x + X 3 we have % = 1 + x and rj = -y. Then 

dy _ 1 y 
dx 2 1 + x 2 ' 

So y = +Vl + x 2 . Again, we check to see if this is a solution to our ODE by substituting it in. (Review 
the Lie series (47) and example 2.13.) The action of the other two symmetries X t X 2 yields the general 
solution of the ODE 

y = ±Vci + (x + c 2 y/c Xl c x = 0. 

Recall that X 1: X 2 are representatives of the classes of generators with 7 = and I > 0, respectively. 
Might there be invariant solutions associated with other generators in these classes? No. None. Zilch. 

The second obstacle we might face in calculating the associated invariant solutions to a Lie 
algebra is that the reduced equation(s) determining one or more invariant solutions may be too difficult 
to solve analytically. Even if we cannot obtain an optimal system of solutions, we may be able to find 
some solutions. In the Hydon text there is an example to this case (example 10.4) dealing with a linear 
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PDE. I have not yet covered symmetry methods for PDEs. Please consult the Hydon book if you wish. 
We will soon return to working problems dealing with both ODEs and PDEs. Only one more theory 
section remains in Part I— yay! 

Discrete symmetries. (Motivation— taken from Hydon's text.) 

One. (Physicist pay attention.) Many nonlinear boundary value problems (BVPs) have multiple 
solutions, and it is necessary to identify when and how the physical system changes its behavior as any 
parameters vary. It is important to identify all of the symmetries in a problem in order to understand its 
behavior fully and correctly. I learned this big time in dealing with thermodynamical systems. 

Two. Discrete point symmetries may be used to increase the efficiency of numerical methods. If a 
BVP is symmetric and the solution is known to be unique (which is quite often the case in physics) then 
computation can be carried out on a reduced domain. Look up spectral methods which may be used 
with basis functions that are invariant under the symmetry. 

Three. As with Lie symmetries, discrete symmetries may be used to generate new solutions from 
known solutions. Discrete symmetries may also be used to simplify an optimal system of generators. If 
two generators are related by a discrete symmetry, you need only one of them. 

Four. (Physicist pay attention.) Discrete symmetries involving charge conjugation, parity change, 
and time reversal (CPT symmetries) are central in quantum field theories. Of course there are many 
more discrete symmetries underpinning general physics. 

Five. (Wow!) We've learned about Lie point symmetries and we're about to learn about discrete 
point symmetries, but there are many more in physics and in mathematics, such as Legendre contact 
transformations (such transformations can occur as symmetries of differential equations, even if there 
are no Lie contact symmetries). Noether's (first) theorem states that any differentiable symmetry of the 
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action of a physical system has a corresponding conservation law. Auto-Buckland transformations (what 
are these?) are nonpoint discrete symmetries which enable us to construct hierarchies of solutions to 
nonlinear integrable PDEs. For differential equations without Lie point symmetries, there are C°° 
symmetries. Symmetries are at the heart of phenomenological physics and fundamental physics. 
Sometimes it is the lab (nature) that leads us to some new symmetry, but it can go the other way 
around. I begin to feel small, like Isaac Newton at the beach picking up a shiny seashell before a massive 
ocean of mystery. At times I feel more like a swimmer who has swum off too far and is now being 
dragged out to open ocean as a tempest begins to brew. I don't have enough of a lifetime to master all 
the symmetries we know of. They are already far too numerous to keep from slipping through my 
fingers. The meaning and magnitude of symmetries yet to be pulled from the depths boggle my mind. I 
suppose this will be so for any being no matter how advanced its civilization, how big and powerful its 
mind might be, infinity is bigger. Everything that is seems to be the result of fundamental symmetries 
and subsequent emergent symmetries. 

How to obtain discrete symmetries from Lie point symmetries. We begin as before, restricting 
ourselves to the problem of the equivalence of solutions that are invariant under a one-parameter Lie 
group of point symmetries. Let x and u denote the N independent and Mdependent variables 
respectively, and let z be the set of all variables, z = (x, u). Let 

T-.z^z (38) 
be a symmetry of a differential equation, the Lie algebra £ is i?-dimensional, and the generators 

X t = Cf (z)d z s (58) 
form a basis where each k 1 is a constant. We showed that if X £ £ then 

X = TXT' 1 . (59) 
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generates a one-parameter Lie group of point symmetries of the differential equation, the Lie algebra £ 
being the set of all generators of Lie point symmetries. Consequently X £ £. In particular, each basis 
generator 

x t = r^r- 1 = cf {z)d, s (60) 

is in £. The set of generators ... , X R ) is also a basis for £, but with z replacing z. Therefore each X t 
may be written as a linear combination of the Zj's as follows: 

Xi = b\X h (61) 
the coefficients b\ being constants determined by the symmetry Y and the basis [X 1} ... , X R ]. If there is a 

diffeomorphism between the z coordinate system and the z coordinate system, then the — are the 

/ dz l 

R x R linear terms of this diffeomorphism. So if follows that the bj = —i, l<i,l<R. It will help 

az l 

simplify things to regard these b\ coefficients as an R x R matrix B = (fcf). Since the linear equations 
(61) are a transformation between basis of Zj's, matrix B is nonsingular. There are M + N total 
variables z. Multiply the RHS of equation (60) by z s to get XiZ s = <"f (z). Multiply this result on the LHS 
by b\ to get 

blX^ = b\$ (z), 1 < i,r < R, l<s<M + N. 

Since i,l < R, the term b\$f(z) is a linear mapping of the M + N (z)'s to the R <"f ( z )' s - We may 
thus write 

${z) d ^- ? = b\X i z s = b l t tfyi l<i,r<R, l<s<M + N. (62) 

This system of (M + N)R partial differential equations can be solved the method of characteristics, 
which yields z in terms of z, the unknown constants b\, and some arbitrary constants or functions of 
integration. This (equation (62)) is so for every symmetry, discrete or continuous. Bear in mind that (62) 
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may have solutions which are not symmetries. How do we check if a solution is not a symmetry? Plug it 
into (43) of course. As we already know the Lie point symmetries, we may factor them out (remove 
them) at any convenient stage of the calculation. What results is the list of inequivalent discrete point 
symmetries that can't be mapped to one another by any Lie point symmetry. 

Example 2.17 — Consider the ODE y" = tany'. We see that With z = (x,y) in this example. From the 
linearized symmetry condition, the Lie generators are X x = d x , X 2 = d y . Given this, we see from 
equation (58), X t = <f (z)d z s, that 

*i = (Kx,y)d z i =x + tf(x,y)d z 2= y = d x 
Then (I (x, y) = 1 and (I (x, y) = 0. From the second generator we see that 

*2 = (Kx,y)d z i =x + Q{x,y)d z 2= y = d y . 
So then ^ (x,y) = and <"f ( x <y) = 1- From equation (61), X t = b\Xi we have 

X-^ — b^X-^ ~\~ b^X-^f X2 b^X-^ ~\~ b^X-^. 

So equation (62) becomes 



x x y x 




\bl 


bl] 






bl 


bl 



So we have x x = bl, x y = bl, y x = bl, y y = b\. So the most general solution to these are 

x(x,y) = b\x + bly + c x , y(x,y) = blx + b\y + c 2 . 

Let's pause and take stock. Here, where we are interested in discovering the discrete 
symmetries. Our emphasis has shifted to the actual relationship between the coordinates in the primed 
and unprimed systems. When were interested finding invariant solutions, we were interested in finding 
the invariant coordinates beginning with r. For the first generator, Xjn this example we have, 
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£ (x, y) = = 1 and ?7(x, y) = = 0. We didn't care about finding the actual symmetry 

connecting (x, y) to (x, y) so long as we had the tangent vector rj), but it's simple enough to see 
from inspection that x = x + s. Repeating all of this for X 2 we see that f (x, y) = (--) = and 

?7(x,y) = ( — ) =1. By inspection y = y + s is the simplest solution for 7y(x,y). So we have 

x = x + s, y = y + e, 

where e which might as well be c x . This is certainly not the most general mapping from (x,y) to (x,y). 
This is what equation (63) gives us. As you can see from x = x + s, y = y + s, the generators X Xl X 2 
generate a constant shift from (x, y) to (x, y), namely the shift. Noting this allows us to "factor out" the 
Lie symmetries so that we're down to 

x(x,y) = b\x + b\y, y(x,y) = b\x + b\y. (63) 
The remaining symmetries may be generated from the above by using the Lie symmetries. For our 
problem every discrete symmetry is of the form (63) for some matrix B up to equivalence under 
translations. Let's substitute (63) into the symmetry condition y" = tany' when y" = tany'. 

m D (d x +y'd y +y"d ,+■■■)$ 

Using the prolongation formula y w = - - = 7 (- , we get 

D x* [d x +y'd y +y"d y i+") x 



HD = - = b J±rty 

} } bl + b\y<- 



With 



y 



( bl + bh' \ ( b\{b\ + bjy) - b\{b\ + bjy') \ 
[2) _D x 9 m _ x Xb{ + bly') _\ {bl + bly'Y ) y _{b\b\-b\ 



2 b 2 2 )y" 



D x 5c D x (blx + b^y) b{ + b\y' {b{ + b\ y y 

Det(B)y" 
= (bl + b 1 2 y'y 
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Let / = Det(B). Then 



Jy" Jtany' (64) 

Therefore the symmetry condition is: 



;(2) = -p" = 

y (bl + bly'Y (bl + bly'Y 



Jtany' (bl + bly'\ 



If we differentiate the above equation wrt y' (noting that d ^ a ", y = sec 2 y' = 1 + tan 2 y') we get 

fly 

/(l + tanV) _ 3^tan/ = f ^fo 1 + 6 2 V) ~ gig? + ^V) ^ ^ + tan2 ^i 2 + bjy' \ 



(bl + bfr)* {bl + b\y'Y \ (bl + b\y'Y )\ \bl + b\y') i 

Cleaning up the RHS we get 



7(1 + tan 2 y') 3fe 2 Vtany' = / / 2 ( b\ + b 2 y' \\ 

{b{ + b\y>y {bl + bly'Y {bl + b\y'Y\ ™ \b{ + b\y')f 



Let's clean up this result to 

<b{ + b\y')J{\ + tan 2 y') - 3b\j tany' = ]{b\ + b\y'Y + tan 2 ^T^y 
Putting the trigonometric terms on the left hand side and the rest on the right hand side we get: 
(bl + bly')J {{bl + fc 2 y )tan 2 ± - tan 2 y' j + 3b\] tany' 

= K + ^V);(i-K + ^V)) 

If b\ 0. Then we have an algebraic equation for tany' in terms of y'. This can't be as the tangent is a 
transcendental function (it has no finite polynomial representation). This forces us to conclude that 
b\ = 0. 
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Jb{ b{tar\ 2 



( 




) 



-tan 2 y' = ]b\{\ - bl). 



The problem persists unless bl = 



1. Then 



tan 2 (bl + bly') - tan 2 y' = 0. 



Finally tan y' = tan(ft 2 + bly') tf b% = a E {-1,1} and bl = qnx, q £ 1. Then (64) reduces to 



Therefore, finally, recalling that we started with x(x,y) = blx + b\y, y{x,y) = blx + b\y. the 
inequivalent discrete symmetries are: 



If £ is abelian and R > 2, computer algebra should be used as the number of unknown 
coefficients b\ increases rapidly with R. If £ non-abelian it is possible to factor out Lie symmetries 
before solving (62). (Often this reduces the number of nonzero coefficients in B from R 2 to R. Then it is 
possible to find the discrete symmetries of a differential equation even if R is not small simplifying 
matrix B using essentially the same method used to classify the generators of one-parameter symmetry 
groups. 

Classification of discrete symmetries. Particle and field theorists usually classify symmetries 
using matrix representations of Lie algebras. If £ is non-abelian then at least some of the commutators 
= cfjX k are nonzero. Therefore the generators belong to nonempty equivalence classes. We 

may use these equivalence classes to simplify B. Recall X t = (A(j, e))™ X m under the Lie symmetries 
generated by X;. We can write equation (61), as 



atany' = tan(<77rx + ay'). 



(x, y) = (x, ay + qnx), 



a G {-1,1}, 



q £ 1. 
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(65) 



where b\ = (A(j, £))^p- We see that equation (65) is equivalent to equation (61) 




(66) 



Then it must be that the solutions z of (65) are related to the solutions of 



(67) 



by symmetries in the one-parameter group generated by Xj. That is, B~A(j, e)B, the tilde denoting 
equivalence in the sense of matrices. To "factor our" the Lie symmetries generated b Xj, solve (67) for 
just one (simple) matrix in this family. 



generated by Xj. Therefore— using the same argument as above— B is equivalent to BA(j, s). An 
equivalence transformation describes the replacement of B with A(j, e)B or BA(j, s). 

For abelian Lie algebras the elements of B are unrelated, but this is not so for non-abelian Lie 
algebras. (Remember that we are finding equivalences between generators that do not commute.) 
These relationships together with the equivalence transformations usually enable us to reduce R to a 
greatly simplified form. (Recall that the structure constants (as the name implies) remain unaltered by a 
change of basis. Then if the generators satisfy [X it Xj] = c^X k they satisfy 



Continuing with the above motif, the generator Xi~{A(j, £)). X m under the Lie symmetries 



(68) 



Substitute X, 



\ = b\X x into [X lt Xj] = cfjX k to get 



b\bJ l \Xi,X w \ — cfjb k X n . 



Then (68) leads to the identities 
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(69) 



These identities are loaded with physics meaning showing you how quantum operators relate to each 
other. The equations are nonlinear constraints on B. The constraints with i > j are essentially the same 
as those for i < j. The constraints are not affected by an equivalence transformation by the matrices 
A(j, s). The order in which the matrices A(j, s) are used does not affect the classification of the 
matrices B. Any ordering gives the same final form provided that the parameters s are chosen 
appropriately. 

Example 2.18 — Assume that we have applied the linearized symmetry condition to some ODE or PDE to 
get a Lie algebra of infinitesimal generators X 1 ,X 2 such that [Z 1( Z 2 ] = The only nonzero structure 
constants are c\ 2 = 1, c 21 = — 1. The constraints (68) (with i < j)) are 



(i.j.ri) = (1,2,1), 



= bl 



(i.j.ri) = (1,2,2), 



and therefore (recalling that B is nonsingular) 



B = 



bl 
b\ 1' 



bl * 0. 



As we did in example 2.15, we need to compute the A(j, s) = e eC( J\ We begin with C(l). 



'M-ii a- 



^ (1 ' £) = io iJ + lilo J + 2! Lo (J + '" = io J" 



^ (2 ' £) = io iJ + TiUi oJ + ^Li oJ + - = l- e J- 
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Multiplying B on the RHS by A(l, e) leading to: BA(l, e) = 



b\ 



to BA(l,e) = 



b\ 
1 



. NowdoSi4(2,e)togetB/l(l,e) = 



M - £ 1 







same as letting b\ = 1 or b\ = — 1. Let's check this. Let b\ = 1. Then ftje £ = ftje 



. Let &2 = f reducing 6^4(1, £) 
. Lete £ = -ln|^|. This is the 

= ble-^\ = ^e ln W = 



4=1- Let b{ = -1. Then -<b? > 0. So 6|e £ = &i e - ln l- 6 il = bU' 1 ^ = ble^V = § = 1. 
cannot simplify S any more. ThusS = ^] ' a = { — 1<1)- 

Example 2.19 — A physics rich example (see SL 2 (M) http://en.wikipedia.org/wiki/SL2%28R%29 . 
Consider sl(2). There are many ODEs and PDEs whose Lie algebra (extracted from the linearized 



We 



symmetry condition) is sl(2) It's structure constants are c\ 2 = —c\\ = 1< c i3 = — c Ii = 2, c 23 
— c| 2 = 1. Go back to example 2.15 for all of the details. 



3 _ 



A(l,e) = 



-£ 
,2 





1 
-2e 1 



A(2,e) = 



e £ 
1 









1 2£ £ l 
1 £ 

1 



The constraints (68), c^plbj 1 = cfj. b£, are highly coupled because sl(2) is a simple Lie algebra (its only 
ideals are itself and the set {0}). For example take n = 1. Then 



b\b\ - b\b\ = b\, 



(70) 



b\bl - b\b\ = 2bl 



(71) 



b\bl-b\b\ = b\. 



(72) 



(It's maddening to read this stuff in a physics text or paper and have no real context like we have.) If 
b\ 0, multiply B on the LHS by A{\, b\/b\), which is equivalent to setting b\ = 0. Then (70) gives 
b\ = 1, and so (72) is satisfied. As a consequence (71) yields b\ = 0. Our simplified matrix B looks like 
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B = 



b\ b 2 b\ 
1 b\ 
bl 



Multiply this Bon the RHS by 4(3, - b\/2bX) to set the (1,2) matrix element to zero. Then the 
remaining constraints (68), cj^blbj 1 = cjj. b£ can be satisfied only if bf = b\ = and ftf = \/b\. 
Lastly, multiply B by A{2, — \n\bl I to get two inequivalent matrices: 



B = 



a 
10 
0a 



a = {-1,1}. 



The last possibility is that bl = 0. Working out the details leads to 



B = 



0a 
0-10 
a 



a = {-1,1}. 



For sl(2) there are four distinct matrices B that are inequivalent under Lie symmetries. 

Example 2.20 — (See Hydon text). The Chazy equation is y'" = 2yy" - 3y' 2 + \(6y' - y 2 ) 2 . If you 
work out the details there are only two real-valued discrete point symmetries (up to equivalence): 

(x,y) = {(x,y),(-x,y)}. 

Here is what I got on the Chazy equation from the internet: a deep connection to mathematical physics. 
The general solution to the Chazy equation can be expressed as the ratio of two solutions to a 
hypergeometric equation. The reduction method leads to an alternative formula in terms of solutions to 
the Lame equation, resulting in a surprising transformation between the Lame and hypergeometric 
equations. 

Example 2.21 — (See Hydon text) In mathematics, and in particular in the theory of solitons, the Dym 
equation (HD) is the third-order partial differential equation 
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u t = U 3 U 



From the application of the linearized symmetry to the HD, we discover that it has a five-dimensional Lie 
algebra. The basis are 

1 

X 1 = d x , X 2 = xd x + ud u , X 3 =x 2 d x + 2xud u , X 4 = d t , X 5 = td t - -ud u . 

The Dym equation represents a system in which dispersion and nonlinearity are coupled together. HD is 
a completely integrable nonlinear evolution equation that may be solved by means of the inverse 
scattering transform. It is interesting because it obeys an infinite number of conservation laws (Wow!); it 
does not possess the Painleve property. A friend of mine thinks particle and field theorists pay too 
much attention to theories that can be linearized and treated by (Feynman) perturbation methods. I 
have a feeling it would take me a long time, months perhaps, to get any kind of real understanding of all 
that is going on with HD equation. There are eight inequivalent real discrete symmetries: 



I am exhausted. When I was a PhD student at the University of Houston Department of Physics, there 
was a Professor Golubitsky who offered classes in areas I am only now just getting enough foundations 
in. He is an expert in bifurcation theory, which describes the way in which nonlinear systems change 
their behavior as parameters are varied. For systems with symmetries, equivalent bifurcation theory is 
needed to deal with degeneracies that are associate with the symmetries (see Golubitsky, Stewart, and 
Schaeffer (1988)). 
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Part I . Chapter 3. (Accessible to sophomores; required for mathematics/physics majors up through the 
postdoctoral research level) On to higher order ODEs. 

The last practical example from chapter two was example 2.8. If you're the sophomore who's 
just finished a first course in ODEs, it's fine to skip from that example to this chapter without any loss of 
continuity for we continue with solving ODEs. You cannot, however, be a master of differential 
equations or a true physicist without learning the classification of continuous and discrete symmetries 
covered in the latter parts of chapter two, and I'm not just talking about stuff important to foundation 
physics like particles and fields. I'm talking about having a clue as to how systems change behavior 
across discrete symmetries (Golubitsky, Stewart, and Schaeffer (1988)). If you've plowed through 
chapter two, a quick review of the first part of chapter two up through example 2.8 is good advice. We 
are going back to example 2.3 and reducing the second order ODE to an algebra equation; we had 
reduced it into two different first order ODEs. 

Chapters 1 and 2 have deeply supplemented and rendered Hydon chapters 1-5, 10 and 11 highly 
transparent and self-contained. Here are the remaining Hydon text goals. 

1- Review the remaining material on ODE symmetry methods in chapters 6 and 7 of Hydon's text. The 
step-by-step notes from chapter 1 through example 2.8 have given you every single tool necessary to 
deal with this material. Thus I will only outline this material. 

2- Show how symmetry methods for ODEs extend to PDEs (Hydon chapters 8 and 9). 

3- Wrap up a few miscellaneous Hydon sections, most importantly dealing with variational symmetries 
(important to physicists). 
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Example 3.1 from 2.3 — Consider the nonlinear ODE y" = ^ — y 2 . Back in example 2.3 we applied the 
linearized symmetry condition to get the Lie point symmetries 

x i = d x> x 2 = xd x ~ 2yd y . 
In reducing the ODE to a first order ODE using X r we had derived the differential invariants 

r i = y. v i = y' 

3 

We used X 2 to derive r 2 = y'y~, but I fed you v 2 If you apply the steps of example 2.7 to this 
example, you get 




III*- ft 

The algebra in example 2.3 then shows v 2 = ^-j = — 1 = ^j^s — 1 = r 2 2 — 1. That is, v 2 = r 2 — 1. 

? y y2-y2 

As you can verify from example 2.3, the generators X 1 ,X 2 form a solvable Lie algebra. These generators 
are, moreover, a canonical basis (see 2 nd half of chapter 2). Thus X 2 generates point transformations of 
the variables (r^Vi). Explicitly, 

X 2 r x = —2y = — 2r 1( X 2 \ 1 = —3y' = —3v 1 . 

(I derived the prolonged generator X 2 ^ in example 2.3. It is X 2 ^ = xd x — 2yd y — 3y'd y i.) Thus the 
restriction (new stuff) of X 2 to (r^Vi) \sX 2 = —2r-yd rx — 3v x d Vv 

We've already chosen the invariant canonical coordinate r 2 = Let s 2 = — -ln^). Then 

ds 2 

ds 2 _ ~dx _ r 2 
dr 2 ~ dr2~ 3r 2 2 - 2v 2 
dx 
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From v 2 = r 2 2 — 1 we see that 

ds 7 



dr 2 r? 2 + 2 



<2 '2 

Quadrature results in s 2 = ^ln(r 2 2 + 2) + c. Rewrite this solution in terms of (r 1( i^) to get the 
algebraic equation 

i 

V\ = ±?i(4c 2 - 2r x )2 + c. 

We have completed one iteration. Now we do another iteration, now using the generator X x to solve 
our algebraic equation. With the canonical coordinates (r, s) = (y, x), we obtain 

ds-i 1 1 
= — =+■ 



dri y ' r^Acl-lrJi 
Therefore the general solution to our ODE is 



s i = c 2 + c i 1 cos h | Ci 
Back in our original variables we get 

y = 2c 2 sech 2 (c 1 (x — c 2 )). 

The biggest take away is the restriction of generators to particular canonical coordinates. 

Please refer to Hydon's text for the next concept: The order which you use the generators can 
short circuit the iteration process . In example 6.2 and 6.3 Hydon treats the ODE 



Iteratively, first with Lie generators ordered as X x = d x , X 2 = d y , X 3 = xd x + yd y , then ordered as 
X r = d y , X 2 = d x , X 3 = xd x + yd y . The first ordering leads to a solution, the second ordering leads to 
a dead end. Order matters. 

A useful high school algebra tip. Sometimes you might get a system of algebraic equations for 
your differential invariants such as 

v 3 — 2(r — c{)v + 4 = 
v 3 - 20 - c 2 )v 2 + 1 = 0. 
As you would with Gauss-Jordon elimination, subtract the bottom equation from the top equation to get 

v 3 — 2(r — c{)v + 4 = 
2(s — c 2 )v 2 — 2(r — c t )v + 3 = 0. 
Multiply the lower equation by an appropriate power of v to eliminate v 3 from the top equation to get 
2(r - c^v 2 - {2(r - cjis - c 2 ) + 3}v + 4(s - c 2 ) = 

2(s — c 2 )v 2 — 2(r — c{)v + 3 = 0. 
Iterate until a solution for v is found: 

6(r - - 4(5 - c 2 ) 2 

v = 

4(r - c x ) 2 - 2(r - c{){s - c 2 ) 2 - 3(5 - c 2 ) 

provided the denominator is nonzero. 

New symmetries obtained during reduction (Important). In some cases the Lie algebra of a 
differential equation is sufficiently large to enable us to solve the differential equation completely. This 
needn't be the case. Let us consider solving ODEs of order n whose largest solvable subalgebras are of 
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order n — 1 or less. Let ... , X s } be a canonical basis for such a subalgebra. As we've learned in 
chapter 2 in terms of the fundamental differential invariants (r s , s s ) of this subalgebra, the ODE is 
equivalent to an ODE of order n — S. The general solution of the reduced ODE is an algebraic equation 

Vs = F(r s ;c 1 ,...,c n - S ). (1) 
If we can get to this solution we are done because (1) is equivalent to an ODE of order S that admits the 
symmetries generated by {X ± , ... , X s }. If we can't solve (1) we might have options. Each subalgebra 
L k = Span(X 1( ... , X k ~) in the solvable chain can be used to reduce the order of the ODE to an equivalent 
ODE of order n — k in the fundamental differential invariants (r k , v k ). So there is a sequence of 
intermediate reduced ODEs, and it may be that one of the intermediate ODEs has NEW point 
symmetries, as well as those inherited from the original ODE. With a sufficient number of new 
symmetries, we might obtain the general solution of an intermediate equation in the form v k = 
F(r s ; C\, ... , c n _ fe ). Then the symmetries in L k may be used to complete the solution of the original ODE. 

2 y" 2 y" y' 2 

Example 3.2 — Consider y'" = + — + — . The linearized symmetry condition leads us to the two- 
dimensional Lie algebra generated by X x = d y , X 2 = xd x . The fundamental differential invariants are 

r-i = x, v-y= y' forXx = SpanfXJ 

r 2 = xy', v 2 = x 2 y" for£ 2 = Span(Z 2 ) 

Choosing the second pair of canonical coordinates and cranking the tools we've learned (and no new 
stuff), we would find out that our ODE is equivalent to — — = 2 2 2 2 . It's symmetries are not 
obvious. However, in terms of the first pair of canonical coordinates, our ODE is also equivalent to the 

2 2 

2 nd order ODE — = — ( -pH + -j + v\ ), which has an eight-dimensional Lie algebra (this is the 
BIG point). The symmetries generated from X 2 are inherited form the original ODE, but the remaining 
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(larger set) of symmetries are new. These new symmetries (see Hydon example 6.5) lead us to the 
solution of our ODE. (These notes give you all the step-by-step tools to work out this problem for 
yourselves.) 

Section 6.3 of Hydon is dedicated to a potentially deep example— the integration of third-order 
ODEs with the Lie algebra sl(2). Hydon present nothing new in this example, but it is interesting 
because shows that the reduced ODE is our famous Riccati equation which can be transformed into the 
Schrbdinger equation. Is there something deep to this connection between Riccati and Schrbdinger? 

Hydon's chapter seven is lengthy, connecting two of our ideas into a new toolset for ODEs, the 
Lie generators we compute for an ODE via the linearized symmetry condition to the method of 
characteristics to find first integrals. It's useful for ODEs whose Lie algebra is not solvable. The method 
covered in Hydon section 7.1 is limited by the need for at least n + 1 generators. Section 7.2 introduces 
contact symmetries and dynamical symmetries. They are defined as follows. A diffeomorphism 



(x,y,y') = (x(x,y,y'),y(x(x,y,y')),y'(x,y,y')) 



is a contact transformation if 

yx + y'y y + y"y y ' 
y (x,y,y ) = - - — . 

x x + y'Xy + y x y i 

You can supplement material on contact transformations by looking them up in Herbert Goldstein's 
graduate text on classical mechanics. Any generator X whose characteristic Q satisfies the linearized 
symmetry condition generates dynamical symmetries (or internal symmetries (does this mean the 
same as internal symmetries in quantum field theories?)). Finally Hydon section 7.3 relates integrating 
factors (studied in regular botany-based ODEs) to the material in section 7.1 Why the rush? 
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How to obtain Lie point symmetries of PDEs. (A junior level course in PDEs is helpful.) There 
are no new big ideas when extending from symmetry methods for ODEs to PDEs. We only deal with 
more indices. Let's begin with scalar PDEs with one dependent variable u and two independent 
variables x and t. We express an n th order ODE by 

A(x, t,u,u x ,u t , ...) = 0. 

We restrict ourselves for now for PDEs of the form 

A= u a — o)(x, t, u, u x , u t , ... ) = 0, 

where u a is one of the n th order derivatives of u and on is independent of u a . It could be that u a is of 
order n — k provided on is independent of u a or any derivatives of u a . A point transformation is a 
diffeomorphism 

T: (x, t, u) — » (x(x, t, u), t(x(x, t, u)), u(x, t, u) 
It maps the surface u = u(x, t) to the surface 

x = x(x, t,u{x, t)), 
i = i(x, t,u(x, t)), 
u = u(x, t,u(x, t)), 
Our goal, namely the symmetry condition for PDEs, is that we want 

A(x, i,u,u x ,Ui, ...) = 

when 

A(x, t,u,u x ,u t , ...) = 0. 
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If this is so, then T is a point symmetry of A(x, t, u, u x , u t , ... ) = 0. To see when this goal is attainable 
we have to know under what conditions we may invert the equations for x and i (at least locally) to give 
x and t in terms of x and i, and similarly for all of the partial derivatives of u and their counterparts u. 

What binds the two coordinate systems together is the total derivative, one for each 
independent variable. In our restricted case the total derivatives are 

Dx = 9 X + u x d u + u xx d Ux + u xt d Ut + 



D t = d t + u t d u + u tt d Ut + u xt d Ut + 



As you can see, total derivatives treat the dependent variable u and its derivatives as functions of the 
independent variables. 

If the Jacobian 



D x x D x t 



* 



(2) 



D t x D t t 

when u = u(x, t), then we may invert the equations for x and i (at least locally) to give x and t in terms 
of x and i. If the Jacobian 3 0, we may rewrite 



u = u(x, i). 



Applying the chain rule to (3) leads us to 



(3) 



D x u 









D x x D x h ru x i 

D t x D t i\ [uj 



By Cramer's rule, then 



1 


D x u 




1 


D x x 


D x u 


3 


D t u 


D t t 


D t x 


D t u 
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Higher order prolongations to higher order partial derivatives are obtained recursively by repeating the 
above argument. If we let Uj be any derivative of u wrt x and i, then 



_ du-j 1 



dx 3 



D x u } D x t 
D t Uj D t t 



_ duj 1 



D% X Dy- Uj 

D t x D t Uj 



For example, the transformation is prolonged to second derivatives as follows: 



_ 1 

"fx - ~ 



D t u x D t i 



u ii = ~ 



D x x D x u ( 
D t x D t u~ t 



1 


D x Ui 


D x Ui 


1 






3 


D t Ui 


D t Ui 


= 3 


D t x 


D t u x 



Given all of this, the point transformation T is a point symmetry of our PDE if 

A(x, i,u,Uz,U{, ...) = 



when 



A(x, t,u,u x ,u t , ...) = 0. 



This symmetry is typically extremely complicated so we will linearize it just as we did for ODEs. Before 
we do this linearization, it is worth working an easy example. 

Example 3.3 —1 claim that 



,'x -1 
(x,t,u) = [— , — ,2(ut-x) 



is a point symmetry of Burger's equation u t + uu x = u xx . The Jacobian of the point transformation is 



3 = 



1 

2t ° 

-x 1 

2f2 4f2 



1 
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Thus 



u x = 8t 3 



2(u x t-\) 
1 

2{tu t + u) ^ 



= 4t(u x t - 1), 



u t = 8f : 



— 2{tu x - 1) 
— X 

^ 2(tu t + u) 



= 8t(t 2 u t + xtu x + tu — x), 



"fx - 8t ' 



4t 2 Uy 





x 1 

4(t / u xt + 2tu x - 1) ^ 



= 8tV 



Then u xx = u t + uu x = 8t 3 (u t + uu x ) = 8t 3 u xx . Indeed then our point transformation satisfies the 
symmetry condition of u xx = u t + uu x when u xx = u t + uu x . 

We cannot in general pull point symmetries to PDEs out of our arses. As with ODEs, we need 
tools to seek out one-parameter Lie groups of point symmetries. By seeking symmetries of the form 

x = x + (x, t, u) + 0(s 2 ), 

i = t + s^(x,t,u) + 0(s 2 ), (4) 

u = u + e^{x, t,u) + 0(s 2 ), 
we impose a set of constraints which we can exploit to tease out point symmetries. Just as for Lie point 
transformations for ODEs (transformations on the plane), each one-parameter, local Lie group of point 
transformations is obtained by exponentiating its infinitesimal generator 

X = ^d x + rd t + r]d u . 

Equivalently, we can obtain (x, i, u) by solving 



d * rr~ - ^ d t r~ " ^ d{L r~ - ^ 

— =<f(x,t,U), — = T{x,t,U), — = T]{X,t,U) 

CLE CLE CLE 
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subject to the initial conditions (x, i, u) £=0 = (x, t, u). 

A surface u = u(x, t)\s mapped to itself by the group of transformations generated by X\f 

X(u - u(x, 0) = (5) 
when u = u(x, t). This condition may be expressed using the characteristic of the group, 

Q = 7] - <fu x - TU t . 

From (5), the surface u = u(x, t) is invariant provided that Q = when u = u(x, t). The equation for Q 
is called the invariant surface condition, a central equation to some of the main techniques for finding 
exact solutions to PDEs. Note: Equation (5) seems stupid. However, looking back at the introduction of 
Q for ODEs, the equation for Q makes sense for PDEs by analogy to ODEs. 

The prolongation of the point transformation (4) to first derivatives is 



u x = u x + r\ x {x, t, u, u x ,u t ) + 0(s 2 ), (6) 
Uf = u t + J7 c (x, t,u,u x ,u t ) + 0(s 2 ). 
We need explicit formulae for rj x and rj l . Let's derive the formula for rj x in full detail. To get rj x plug in 



the three equations of (4) up to first order into 3 = 



D x x D x t 



, and into % = 



D t x D t t 

D x = d x + u x d u + u xx d Ux + u xt d Ut + -, 
D t = d t + u t d u + u tt d Ut + u xt d Ut + 



D x u D x t 
D t u D t t 



. Recall: 



3 = 



D x x 


D x i 




D t x 


D t t 





D x (x + £%(x, t, u)) D x (t + £%(x, t, u)) 
D t (x + e^{x,t,u)) D t {t + £^(x,t,uj) 



1 + £% x + £U X % U £% t + £U t T u 
£^ t + £U t ^ u 1 + £T t + £U t T u 



= (1 + £% x + £U X Z U ~)(1 + £T t + £U t ) - (£% t + £U t Z u )(£t t + £U t T u ). 

Dropping all terms with of order £ 2 or higher we get 3 = 1 + £(r t + u t r u + % x + u x ^ u ). Now 
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D x (u + (x, t, u)) D x (t + £% (x, t, u)) 
D t (u + £^(x,t,u)) D t (t + £f(x,t,u)) 



I £7J ^ I £\L^£ £T % I £\L^ 

U t + £T] t + £U x T] y l + £T t + £U t T u 



So, 



= ^ («% + + £"x*7u + ^%T t + £U x U t T u - £U t T x - £U t U x T u ). 

-v5 



1 + £(T t + U t T u + % x + U x % u ) 



Recall — « 1 — x for small x. Thus 



U x = (ll x + £{j] x + U X T] U + U x T t - U t T x ))(l - £(T t + U t T u + % x + U x % u )) 

— \L% ~\~ £Yjx ^^X^llL ^^X^t ^U't^X ^^X^t ^^X^t^lL ^^x^>x ^x^u 
= U X + £7] x + £U X 7] U - £U t T x - £U x U t T u - £U X ^ X - U x f u 
= U X + £<J] X + U^u) - £U X (^ X + U x <fJ - £U t (T x + U X T U ) 
= U X + £(D x r) - U X D X % - U t D t T). 

Since to first order u = u + £%(x, t, u), we see that 



rj x (x, t, u, u x , u t ) = D x rj - u x D x % - u t D x r. 



If you repeat all of this work using the Jacobian and u t = 



D x x D x u 
D t x D t u 



, you will arrive at: 



rf (x, t, u, u x , u t ) = D t r] - u x D t ^ - u t D t T. 



We use recursion to prolong the transformation to higher order derivatives. Suppose that 



d jl+h u 

u J =u J + en> + Otel u ] = ——. 



for some integers j 1 ,j 2 - Then (just as for rj x and rf) with 
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duj 1 



dx 3 



D x v.j D x t 
D t uj D t t 



duj 
}t dt 



D x x D x Uj 
D t x D t Uj 



We get 



uj x = Dj x + sr]J x + 0(e 2 ), 



u ]t = D Jt + Sri*' + 0(£ 2 ), 



where 



r} jx = D x r] J - u JX D x % - u Jt D x T, 
t] Jt = D t r] J - u JX D t % - u Jt D t z. 
Alternatively, we can express the functions rj J in terms of the characteristic, e.g., 

r] x = D X Q + %u xx + ru xti 
if = D t Q + fU xt + zU tt . 
The higher order terms are obtained by induction on j ± and j 2 : 

r] J = DjQ + $DjU x + zDjU t 

where D } = D^D 12 . 

The infinitesimal generator is prolonged to derivatives by adding all terms of the form n ] d U; up 
to the desired order. For example, 

XV> = ed x + rd t + r]d u + rj x d Ux + = X + r] x d Ux + Tfd Ut , 
X (2) = Z (i) + + ^tQ^ + ^tQ^ 
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For simplicity, we adopt the notation that the generator is understood to be prolonged as much as 
necessary to describe the group's action on all of the variables. To find Lie point symmetries, we need 
explicit expressions for rj jx and rj Jt . Here are some (you know how to derive them). The first one is a 
cut and paste and slight rearrangement from the detailed derivation of u x : 

n x = + Olu ~ tx)u x - T x u t - <f u u£ - z u u x u T 

V f = Vt - ttUx + Olu - <f*K - tv.U x U t - T u ul 
V XX = Vxx + (2??xu — %xx) u x ~ r xx u t + (Jluu ~ 2% xu )lLx — 2T xu U x U t — f uu u| — T U u u X u t 

+ Olu ~ ^x) u xx ~ 2r x u xt — 3^ u u x u xx — T u u t u xx — 2r u u x u xt . 

l Xt = Ixt + (Jltu ~ ^xt) u x + (Jlxu ~ T xt) u t ~ ^tu u X + (Jluu ~ ^xu ~ T tu) u x u t ~ T xu u t ~ ^uu u X u t 

~ T uu u x u t ~ %t u xx ~ %u u t u xx + (Jlu ~ %x ~ T t) u xt ~ 2% u U x U xt — 2r u U t U xt — T x U n 
— T U U X U XX , 

r l tt = Vtt ~ ^tt u x + (2??tu ~~ T tt) u t ~ 2% tu u x u t + (j] uu — 2r tu )u^ — ^ uu u x uf — r uu uf — 2% t u xt 
- 2% u u t u xt + (r] u - 2r t )u tt - % u u x u tt - 3r u u t u tt . 

Lie point symmetries are obtained by differentiating the symmetry condition A(x, i, u, u x , % ... ) = 
when A(x, t, u, u x , u t , ... ) = wrt s at s = 0. We obtain the linearized symmetry condition 

XL = when A = 0. 

The restriction A= u a — u>(x, t, u, u x , u t , ... ) = lets us eliminate Uo-from XA = 0. The we split the 
remaining terms according to their dependence on derivatives of u to obtain a linear system of 
determining equations for s, z, and rj. The vector space £ of all Lie point symmetry generators of a 
given PDE is a Lie algebra, although it may not be finite dimensional. 
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Example 3.4 — Consider u t = u x . The linearized symmetry condition is rf = 2u x rf when u t = u x . 
Using u t = u x to eliminate u t , let's write the linearized symmetry condition explicitly 

Vt ~ ZtUx + Olu ~ T t )ux ~ SuU-x ~ t u u x = 2u x (r] x + (r] u - $ x )u x - {$ u + T x )ul - t u uI). 

After equating the terms that are multiplied by each power of u x , we are left with the system of 
determining equations: 

t u = 0. (7) 
5 U + 2z x = 0. (8) 
r] u + T t - 2f x = 0. (9) 
% t + 2r] x = 0. (10) 

lit = 0. (11) 

(These equations are ordered with u x terms first, followed by the uf terms and so forth. Solving (7) we 
get 

t = A(x, t), 

where A is an arbitrary function for the moment. Given this result, it follows that (8) has solution 

<f = -2A x u + B(x, t), 

so (9) yields 

7] = ~2A xx u 2 + {2B X - A t )u + C(x, t), 
for some arbitrary functions B and C. When we substitute our results into (10) and (11) we get 

-\A xxx u 2 + \{B XX - A xt )u + B t + 2C X = 0, 
-2A xxt u 2 + {2B xt - A tt )u + C t = 0. 
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Since the functions A, B, and C are independent of u, the above two equations can be decomposed by 
equating powers of u as follows: 

Q = 0, 
B t + 2C X = 0, 
2B xt - A tt = 0, 
Bxx ~ A xt = 0, 
A-xxt = 
Axxx = 0- 

Using each of the first three of these equations, we get 

C = a{x), B = —2a'(x)t + B(x), A = -2a"{x)t 2 + y(x)t + S(x), 

where a, B, y, S are functions of solely x that are determined by substituting A, B, and C into B xx — 
A xt = 0, A xxt = 0, and A xxx = 0. Equating equal powers of t and solving the resulting ODEs. We get 

^ = —\c x tx — 2c 2 t + c 4 ^- x 2 — 2tuj + c 6 x + c 7 — 4c 8 xu — 2c 9 u, 

t = — 4c x t 2 + c 4 xt + c 5 t + c 8 x 2 + c 9 x + c 10> 

rj = c x x 2 + c 2 x + c 3 + c 4 xu — c 5 u + 2c 6 u — 4c 8 u 2 . 

Because there are ten arbitrary constants, the Lie algebra is ten dimensional. 

Hydon's text outlines a few more examples of this symmetry approach to PDEs in his chapter 8. 
The method generalizes to PDEs with M dependent variables u = u{v}, ... , u M ) and N independent 
variables x = x(x\ ... , x N ). Finally Hydon describes and cites the use of computer algebra tools. 

115 



Methods for obtaining exact solutions to PDEs. Just as with ODEs, the symmetry toolset we 
have acquired for PDEs yields the generators of the PDE. For ODEs, we used these generators, then, to 
extract invariant solutions. The same applies to PDEs. 

In a typical first PDE course one learns to solve PDEs by various methods including: similarity 
solutions, travelling waves, separation of variables, and so forth involving ansatze. Though not 
advertised, many of these methods involve nothing more than looking for solutions that are invariant 
under a particular group of symmetries. For example, PDEs for u(x, t) (like wave equations) whose 
symmetries include X x = d x and X 2 = d t generally have traveling wave solutions of the form 
u = F(x — ct). These solutions are invariant under the group generated by 

X = cX 1 + X 2 = cd x + d ti 

because both u and x — ct are invariants. In the same way PDEs with scaling symmetries admit 
similarity solutions, which are constructed from the invariants of the group. 

Let us generalize the idea to any Lie group of symmetries of a given PDE A = 0. For now we 
restrict ourselves to scalar PDEs with two independent variables. Recall that a solution u = u(x, t) is 
invariant under the group generated by 

X = ^d x + zd t + r]d u 

iff the characteristic vanishes on the solution. That is, every invariant solution satisfies the 
invariant surface condition 

Q = T] - <fu x - TU t = 0. (12) 

(Review the parallel theory and examples for ODEs.) Usually (1 2) is very much easier 
to solve than the original PDE, as we have seen for ODEs. Don't forget that we have to check 
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the solutions we get by plugging them back into the original PDE. For example, the group 
generated by X = cX 1 +X 2 = cd x + d t has the characteristic 

Q = ~cu x - u t . 

The travelling wave ansatz u = F(x - ct)\s the general solution of the invariant surface condition 
Q = 0. 

Suppose for now that f and t are not both zero. Then the invariant surface condition is a first- 
order quasilinear PDE that can be solved by the method of characteristics. The characteristic equations 
are 

dx dt du 
t t f] ' 

If r(x, t, t) and v{x, t, u) are two functionally independent first integrals of the characteristic equation, 
every invariant of the group is a function of r and v. Often it is convenient to let one invariant play the 
role of a dependent variable. Suppose WLOG that v u 0. Then the general solution of the invariant 
surface condition is v = F(r). The solution is now substituted into the PDE A = to determine the 
function F. 

If both r and v both depend on u, it is necessary to find out whether the PDE has any solutions 
of the form r = c. These are the only solutions of the invariant surface condition that are not (locally) of 
the form v = F(r). If r is a function of the independent variables x and t only, then r = c cannot yield 
a solution u = u(x, t). 

Example 3.5 — Consider the heat equation u t = u xx . The steps you will see below are highly reminiscent 
of the kinds of PDEs you will struggle with in graduate electrodynamics (think Jackson's text). It has 
many symmetries. Consider the two-parameter Lie group of scalings generated by 
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X 1 = xd x + 2td t , X 2 = ud u . 
Every generator of a one-parameter Lie group of scalings is of the form (see 2 nd half of chapter 2) 

X = hX 1 + kX 2 , 

for some constants h and k. Remember that if A is any nonzero constant, X and AX generate the same 
one parameter group (see chapter 2). (The group parameter s is changed, but this does not affect the 
group.) Therefore if h we may assume that h = 1 WLOG; if h = 0, set k = 1. 

Suppose that h = 1, so that 

X = xd x + 2td t + kud u . 

The invariant surface condition is 

Q = ku — xu x — 2tu t = 0, 

which is solved by integrating the characteristic equation 

dx dt du 
x It ku 

_i _fc 

Carrying out the integrations yields r = xt 2 and v = ut 2. Because in this case r is independent of u, 
every invariant solution is of the form v = F(r). This is equivalent to u = UF (xt~ ). Then 

u t = t (*-2)/2 (_l rf '( r ) + l/cF(r)^, 
u xx = t«-^F"{r). 
Therefore u = UF (xt~ ) is a solution to the PDE if 
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1 1 

F" + -rF' --kF = 0. 



The general solution of this ODE is 

F(r) = Cl u(k + ^, 2~^rj + c x V (k + ^ 2~2r\ 



where U (p, z) and K(p, z) are parabolic cylinder functions. If k is an integer, these functions can be 
expressed in terms of elementary functions and their integrals. For example, if k = then 



F(r) = d erfQ + c 2 



where 



2 r° 

erf{z)= — \ e^ 2 d( 
is the error function. If, on the other hand, k = — 1, 

r 2 / r 2 / f Z <T 2 / 

F = qe" 7 4 + c 2 e~ 7 4 e 7 4 d<\ 

Jo 

Substituting these results into 

u = t2F (xt~A 

results in a large family of solutions which includes the fundamental solution 

1 / X 2 I 

u = t~ '2e~ k = -1. 



the error function solution 



U = er/ (^)' * = °' 
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and many other well-known solutions. Get more out of Jackson's "Classical Electrodynamics". 

Hydon's chapter nine covers a more PDE examples, including how to get new solutions from 
known solutions, and the use of nonclassical symmetries. Except for chapter seven, I've rendered 
Hydon's eleven chapter text more transparent to sophomore students and above. Get it. Do it. 



120 



Lagniappe 

Once you know the simplest solution to some differential equations, you may employ very 
clever algebra to extract the rest of the solutions. Enjoy the next two pages and a half. Consider a 
spring-mass system with spring constant k and mass m. It's total energy is 



Px 1 77 

H = h -m<y z x z , 

2m 2 



where the frequency is v, u> = 2nv, -m<y 2 x 2 is the potential energy, ^ = = -mv 2 is the kinetic 
energy, and H = E the total energy. Let's simplify things with 



p 2 = P^ ) q 2 = ma) 2 x 2 
m 



(Q is used in quantum mechanics instead of X, ditto q instead of x.) Then 



H = ^(P 2 + Q 2 ). 



We turn this (Hamiltonian ) H (total energy) into a Schrbdinger (differential) equation by letting 



— ih d -i 

P = - 1 =—, Q = yma)q. 
Vm oq 



Now we have (a simple quantum model of an electron oscillating from its equilibrium radius. 



H = ^(P 2 + Q 2 ). 



Let us study the commutator of P and Q. 



r ~ ~ n ( ih d f — . — ih d \ dtp dip 

\P>QW = (PQ - QP)4> = \--^-^-{vmoyq) + ^mcoq—=—\\p = -iha)ip - iha)q — + icoqh — 

\ y/m oq v yjm oq/ oq oq 

= —ihcLtxfj. 
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So [P, Q] = —ihco. As with electrons orbiting nuclei in discrete orbits with discrete energy levels, the 
electrons in this model only oscillate at discrete frequencies corresponding to discrete energy levels— 
the mathematics will bear this out in a page. For each integer n there corresponds an energy E n (an 
eigenvalue) and a wave function xfj n (eigenfunction) which satisfies the differential equation 



2m dq 2 



— mco l q 2 \p n = E\p n n = 1,2, , 



Ladder algebras. For the classical equation (P 2 + Q 2 ) = (P + iQ)(P — iQ). For the quantum 
mechanical equation this is so. We instead get 

(P + iQ)(P - iQ) = P 2 + Q 2 + i{PQ - QP) = P 2 + Q 2 + i(-ih(o) =P 2 + Q 2 + ha) = 2H + hcol, 

because P, Q obviously don't commute (thus being subject to the Heisenberg uncertainty principle). 
Here I is the identity operator (doesn't do anything; it's the one, the unit.) 

Now consider 

(P - iQ)(P + iQ) = P 2 + Q 2 - i(-ihay) = P 2 + Q 2 - ha) = 2H - hcol. 

So 

P 2 + Q 2 = (p + iQ)(p + iQ) ± hcol. 

Lastly consider 

H{P ± iQ)ip n = \{P 2 + Q 2 ){P ± iQ)i> n = \{ p ± l QW + l QW ± iQ)l>n ±\hcol{P ± iQ)ip n 

= \{P± iQ)(P 2 + Q 2 )i>n ± \ hcol(P ± iQ)xl) n = (P ± iQ)Hip n ± X - hcol{P ± iQ)ilj n 
1 

= (P ± iQ)E n ip n ±-hcol{P ± iQ)xlj n . 



122 



Thus 

H(P ± iQ)ip n = (e u ±\hco^ (P ± iQ). 

i 

So the energy levels of the (harmonic oscillator) electron are equally spaced by - ha). 

Let E denote the lowest energy level corresponding to wave function xfj the so-called ground 
state. Then, since we can't get to a lower energy state than the lowest energy state, 

(P - iQ)ip = 0. 

Now, 

implies that 

X - [(P ± iQ){P + iQ) + ha)i\il> = EtP 0i 

but (P + iQ)\p = 0, so 

Hxfj = Eifj . 

i 

Therefore E = E = - hu> must be the lowest possible energy state (the ground state). E is also called 

i 

the zero point energy (energy can never be zero since -hen > 0). 

For shorthand, let R + = (P + iQ), R_ = (P - iQ). Then (iterating n times) HR+xfj = 
(E + nhu>). Try plugging in. R + is a raising operator (or creation operator), while R_ is a lowering (or 
annihilation) operator. In quantum physics we have ladder operators for the energy of the harmonic 
oscillator, angular moment, and so forth, and in particle physics (requiring relativistic quantum 
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mechanics) we have ladder operators to create or destroy particles, e.g., an electron and positron 
annihilate each other to create a photon. Cool stuff. 

If we can find x/j we can find xfj n purely by our ladder algebra. Let's find that zeroeth 
eigenfunction. 

U = (/»-^o = (^+^)*. = o. 

The solution to this simple ODE is 

( Q 2 \ ( mcoq 2 \ 

xjj = c e y 2 ^)H (Q) = c e \ ™ )h (Q), 
where c is an arbitrary constant and H n (Q), n = 0,1. , „ are the Hermite polynomials. Then 




Indeed H = 1, H 1 = 2Q, H 2 = 4Q 2 — 2, .... We are generating the Hermite polynomials. 

You have now seen that linear algebra, modern (abstract) algebra and differential equations are 
not disjointed. They are bound together by the unifying methods of symmetry methods in great part 
because our nature is bound by symmetries. There is more of this unifying still to go. Along the way we 
will pick up topology and algebraic topology and some differential geometry. You now have at your 
fingertips powerful tools to treat linear and nonlinear ordinary and partial differential equations and you 
have deep insights into classical and quantum physics and the problems of mathematical physics. 
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Part 2 . (Accessible to sophomores; required for mathematics)/physics majors up through the 
postdoctoral research level) Action principles and the calculus of variations. 

You, person A is walking along the shore (the y = horizontal line) when you notice person B 
drowning a distance d meters along the shore and y meters into the water. The speed at which you run 
on sand, v r is faster than the speed at which you swim, v s . 

B 

^ y 

A D-x x 



You'll run along the line segment D — x, and then you'll swim the hypotenuse of the triangle 
with sides x and y. Treating nature as continuous , there are an infinite number of choices you can 
make on x before jumping into the water, but there is only one optimal choice, the x that minimizes 
time. We require only regular calculus to find this point x. The total time to reach B from A is 



D — x Jx 2 + y 2 
t = + - — 



V r 17, 



w 



Compute the derivative of t wrt x and set it to 0: 



dt 1 x 

— = + = 0. 



1 

x 2 



The solution is x = (j^j — 1 \ y- Now hurry! Out of an infinite number of choices we have found 
the one. 
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Now tell me what is the shortest distance between two points on the plane? There are 
infinitely many functions I can imagine connecting the two points. I have asked you to find the function 
that minimizes distance. This question is in the purview of the calculus of variations. I let one point be 
the origin = (0,0) and the other point (x, y). If 



ds 2 = dx 2 +dy 2 = (l + Q j dx 2 , 



then the arc-length of the curve y(x) is 



s = J h + (_±j dx = J Jl+y' 2 dx = J 2(x,y,y')dx 



I'll prove to you that what minimizes s is the solution to the ODE when we derive the equation below 

d df 32 _ 
dxdy' dy 

where / is afunctional (a function of functions). Let's plug into the above equation. 



d df d d I , d y' 

— = l + y' = 

dxdy' dxdy'\ dx \ ~ 



df _ d 
dy dy 



1+y' 2 



1 + y' 2 = 



So 



d y' 

= 0. 



dx 



1+y' 2 



Integration leads to , y = m = constant. This is only so if y' = m. Then y(x) = mx + b. 
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Action principles are principles that extremize functional, which are functions of functions, 
producing either minimal or maximal functions. The fundamental laws of our universe can be expressed 
in terms of action principles, as well as many emergent laws, like raindrop splashes crowning into 
symmetric beads and snowflakes forming into six sided shapes. Action principles produce differential 
equations that are rife with symmetries. This has happened often in particle physics, but one could 
argue for the reverse case. Nature is rife with symmetries that lead us to differential equations that may 
be seen as generators of solution curves which extremize some action. We shift our focus a little bit 
from this "reverse" point of view if we prefer to think of symmetries as measures of invariance, a 
triangle on a plane being invariant to a handful of rotations and reflections about the plane, spacetime 
being invariant to continuous Lorentz transformations. This was the path to both special and general 
relativity. As we have seen for differential equations, invariances can be continuous or discrete. We 
have an interesting chicken-egg problem. A third point of view is that symmetries thought about in 
terms of commutators and the concepts of Lie algebras is that symmetries measure interaction. (Anti-) 
commutators and annihilation and creation operators of particles, be these electrons or strong nuclear 
force gauge bosons, or theoretical particles such as supersymmetric particles, express interacting 
particles and fields. A fourth flavor that I see is that commutators measure "entanglement" of variables, 
space-time being "entangled" in special relativity by Lorentz transformations which in turn "entangle" 
particles, like the electrons and positrons of the Dirac equation being forced by local relativistic 
invariance to interact with (gauge boson) photon fields described in terms of vector potentials/covariant 
derivatives. The mathematicians have now come to see gauge fields as essentially a measure of the 
curvature of a connection on some fiber bundle, requiring a background in geometry and local and 
global algebraic topology. At the end of these notes I have an essay/syllabus of good books and ideas 
that render this paragraph meaningful if it isn't yet so. These notes are themselves a skeleton of the 
ideas in this paragraph. In any case, action principles are formulated using the calculus of variations. 
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Let's begin developing the calculus of variations. A great, cheap reference book is Elsgolc, now 
in a Dover edition. Elsgolc develops the theory in parallel with the first year calculus. My approach will 
be a little more succinct. Consider a function y(x) that is at least twice differentiable in a domain with 
boundaries x A and x B corresponding to points y A and y B respectively. We seek to extremize the 
integral 

r x B 

J = f(x;y,y')dx. 

Jx A 

Clearly / is a functional. (Later we shall generalize the theory for f(x; y, y ' , ... , y ) Let the solution, 
whatever it is, be y (x). Let ?y(x) any twice differentiable function that vanishes at (x A ,y A ) and 
(x B ,y B ). That is r]{x A ) = rj(x B ) = 0. Then the linear combination of y (x) and rj(x), 

y(x,a) = y (x) + ar)(x) 

satisfies y{x A , a) = y A and y{x B , a) = y B for all values of the real-valued parameter a. Let's see how 
this looks like. 

xy-plane 

y(x, a) 




A 



The way the figure is drawn, y(x, a) is close to y (x) in the sense of |y(x, a) — y (x)| is small. In fact, 
the curves are also close in the sense that |y'(x, a) — yo(x)| is small, and so on to higher order 
derivatives. I might as well generalize the picture. Had I drawn the picture more like 



128 



xy-plane 

y(x, a) 




then it is still true that |y(x, a) — y (x)| is small, but it is no longer true that |y'(x, a) — y' {x)\ is small. 
So let me just define closeness of order k. Two curves y (x) and y x (x) are /c-order close if jy(x, a) — 

y (x),y'(x, a) — yo(x), ...y^ k \x, a) — y^Cx)} is small. This definition will be useful we generalize the 

calculus of variations for functionals depending on x; y,y' , Getting back to the first picture, the 

new parametric function y (x, a) represents a continuum of different paths than y (x) between the 
boundary points A and B, one path for each value of a. None of these curves extremizes our functional 
except the curve for which a = 0. Ah! So the functional is really no longer a functional. It is simply a 
function of the parameter a. That is, 

/(«) = I /(x;y(x,a),y'(x,a))dx. 
Jx A 

We are back to the usual calculus. Let's differentiate /wrtcr: 

( dJ \ d Tor c . <( ^ ( XB {df dy(x,a) df dy'jx.a) ) 

{da) a=0 = da ) XA £(X; y (X ' a) ' y (X ' a))dX = ) XA {Ty^a- + 3/ dX = °" 

dy(x,a) r ~\ i dy'(x,a) d \dy(x,aT\ d \dy(x,aT\ dn(x) 

By our construction : = ri(x) and 3 = — = — , = -7^-. Thus 

da v 9a da L J dx L aa J dx 
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Let's do each integral apart and evaluate the second integral using integration by parts to get 



['•dfdrjix) f'if df (",.d(df\ 



x A J x A 



The first term is zero at the boundary points. Put the remaining part above with the first term: 

This is a necessary (not sufficient) condition to have a minimum at a = 0. Since rj(x) is arbitrary, 

dy dx \dy'J 

Voila! We have the Euler-Lagrange differential equation. We have found a condition for finding a path 
that extremizes /, the Euler-Lagrange differential equation. Physicists normally write £ instead of /, 
calling £ the Lagrangian, which is the difference of the kinetic energy and potential energy, £ = T — V. 
In physics, action is an attribute of the dynamics of a physical system. It is a mathematical functional 
which takes the trajectory, also called path or history, of the system as its argument and has a real 
number as its result. Generally, the action takes different values for different paths. The Euler-Lagrange 
differential equations extremize the action: SL = 0. 

Example 1.1 — Consider a spring mass system with mass m and spring constant k. The kinetic energy is 
T = |mx 2 and the potential energy is V = ^kx 2 . Thus £ = |mi 2 — \kx 2 . The Euler-Lagrange 
differential equation is 

d dL dL 

— — — — = mi — kx = 0. 

dtox ox 

There is your differential equation of motion. We've seen its quantum mechanical counterpart. 
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If the Lagrangian does not depend on the independent variable the second order Euler-Lagrange 
differential equation becomes first order, and as physicists we know that a quantity will be conserved, 
e.g., angular momentum. To show this consider the following two derivatives: first the total derivative 



df df df .dfdy' 

— = 1 y H , 

dx dx dy dy' dx 



then is the second derivative 



d_( , df\ _ dy' df , d / df \ 
dxV dy') dx dy' y dxKdy'J 



Combining these two under the assumption that / doesn't depend on x, = 0) leads to (with algebra) 



dxV y dy') 7 



dy dx\dy')\' 



If y(x) minimizes the functional / then the Euler-Lagrange equation becomes 



d ( df\ df 



where is an arbitrary constant. 



Example 1.2— Consider two objects of mass m x and m 2 orbiting each other at r x and r 2 . The center of 
mass is R and r = r 2 — r x . The Lagrangian £ = ^(jn 1 + m 2 )i? 2 + \\^ 2 + ^fJ.r 2 6 2 — G ^ 2 , where 




H = ^ mi+m2 ^ since there is no R in the Lagrangian, then ^- (- (m-^ + m 2 )i? 2 ) = 0. So the center of 



mass is an invariant (a symmetry). Ditto for 9. Hence the angular momentum is conserved. That is 
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^(jj" 7 " 2 ^ 2 ) = so ^[ir z 2 = constant = L. Here L is the angular momentum of the system. This 
property of conservation of some quantity was generalized by Emmy Noether (generalizing the work of 
Sophus Lie). Noether's (first) theorem states that any differentiable symmetry of the action of a physical 
system has a corresponding conservation law. By the way, in this example I snuck in a Lagrangian with 
more than one independent variable. Can the resulting Euler-Lagrange differential equations for 
multiple independent variables be coupled? Why yes they can. 

Example 1.3 — Using two wires of length I, go to your ceiling and suspend to massive bowling balls of 
mass m from it separated by, say, half a meter. Then couple these bowling balls by attaching a weak 
spring between them. Let the spring constant be k. Give one ball a nudge towards the other ball, small 
enough to get the ball swinging but so much as to make it run into the other ball. Eventually, thanks to 
the spring between the balls, the other ball will begin to swing. Let Q x measure the angle of the first ball 
with respect to its resting position (hanging straight down), and let 9 2 measure the angle of the second 
ball from its resting position. Then the kinetic energy is 

T = ^ml 2 (0 2 + 9 2 ). 

The potential energy is 

1 

V = mgl(l — cos 9-J + mgl(l — cos 9 2 ) + -/cZ 2 (sin 8 r — sin0 2 )- 
If these angles are sufficiently small then 

1 , 

V ~ mgl(l ~ cos X ) + mgl(l ~ cos 6 2 ) + -kl 2 ^ - 2 ). 

The last term is the source of the coupling. If you change the weak spring into a super long string, then 
k = 0, and the coupling is killed. So £ = T — V. The Euler-Lagrange differential equations lead to 
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ml 2 B\ + mgW 1 = -2kl 2 {Q x - 9 2 ), 
ml 2 e 2 + mgW 2 = 2kl 2 {6 1 - 6 2 ). 
This folks is a coupled system of differential equations. The sum of the two equations is 

ml 2 {9 1 + 6 2 ) + mgl(6 1 + 6 2 ) = 0. 
The difference of the top equation minus the second equation is 

ml 2 {6 1 - 6 2 ) + mgl(6 1 + 6 2 ) = -4kl 2 (9 1 - 6 2 ). 
For kicks, let x = (e\ + 8 2 ) and y = (6\ - 8 2 ). Then 

ml 2 x + mglx = 0, 
ml 2 y + mgly = —4kl 2 y. 

Simplifying leads to 

x + —x = 0, 
(q 4k\ 

Let % = Jf, a frequency, and le, o, y = Jf7| = Jf(l+^) «= Jf (l + if 41* « mg . For 
solutions try 

x(t) = c x sin u> x t + c 2 cos a) x t, 
y(t) = c 3 sin o> y t + c 4 cos u> y t. 
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We specify initial conditions, say, x(0) = 0. Thus c 2 = 0. Fory, specify y(0) = 0. Then c 4 = 0. Let's 
say at t = 0, the instant you nudge ball 1, it has instantaneous angular speed #i(0) = 9 . Then 
x(0) = 9 = c 2 a) x . Soc 2 = 6 /a) x . Noteif0 2 (O) = then x(0) = y(0). Theny(O) = 9 = c 4 a) y , and 
so c 4 = 9 /(jL> y . Finally, 



9 lit) = 9 I — sma) x t H sina) y t J, 



9 2 (t) = 9 [ —sma) x t — sina) y t 



(li X 0)y 



The motion of one ball affects the motion of the other ball because they are coupled by a weak spring. 
Example 1.4— Show and tell. The following is the Einstein-Hilbert action 



S = T K j R ^ d4x - 



It leads to the Einstein field equations 



1 _ 8nG 



These really are nothing more than Newton's F = ma, but in a curved four-dimensional curved space- 
time where the matter/energy fields couple to the space-time curvature (and vice-versa). The key 
invariance (symmetry) that Einstein found was the indistinguishability of gravitational mass from inertial 
mass. The Standard Model has its Lagrangian formalism. 

If the physical system has constraints, the Euler-Lagrange differential equations need to account 
for the constraints. (Imaging threading a bead onto a long wire, which we bend into a circle. Suspend 
the wire circle from the ceiling and spin it. The bead might slide up and down, but always stuck to the 
wire.) Without proof, if the constraints are specified by £ fe a ik Sq k = 0, then the Euler-Lagrange 
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equations become 

There is a way to extend this formulism for problems involving velocity dependent potentials. Finally, if 
you recall, 

xy-plane 

y{x, a) 




the theory extends to 

J = f{x;y,y' y™)dx. 

Jx A 

The Euler-Lagrange differential equations become, 

The calculus of variations spits out differential equations. Symmetry methods for differential equations, 
though not fully general, help us unify our treatment of differential equations. Do you feel like you're 
beginning to get the keys to a large class of universes? 
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Part 3 . (Accessible to possibly juniors, definitely seniors; required for mathematics/physics majors up 
through the postdoctoral research level) To our differential equations and abstract algebra we know 
add in topology. ( 8.5 pages of structure to first unifying example; you'll see the theory is nothing deep.) 

Most of the topology we'll see will be point set topology. As with abstract algebra, 
mathematicians have done a fine job in rendering topology a disjointed witch's brew of meaningless, dry 
abstraction. Algebraic topology is useful you'll see. These notes are from Gilmore's Dover book. 

The origin of point set topology is the real number line. The properties of the real number line 
have been extended to higher dimensional manifolds, e.g. the xy-plane, the surface of the sphere, and 
even abstracted to build new kinds of "weird" manifolds. Physicist pretty much stick to continuous 
manifolds. Let's review the properties of the real number line which we will use (an activity you would 
do in a third or fourth year undergraduate course in real analysis). We will quickly return to Lie groups, 
Lie algebras and differential equations. Our goal will be to understand Lie's three theorems. The payoff 
will be deep insight into the nature of quantum fields and general relativity. 

Though not necessary, it would be good to review to at least at the level of first year calculus the 
following concepts: limits, limits of functions, continuous functions, continuity, uniform continuity, 
sequences, possibly limit infimum and limit supremum, Cauchy sequences, sequences of functions, 
uniform convergence, and series. A very good and compact source of all of this stuff is chapter 1 (9.5 
pages) of "Real Variables," Murray R. Spiegel, Schaum's Outline Series. The 9.5 pages of theory is 
followed by nearly twenty pages of easy, step-by-step examples. Schaum's Outline Series books are 
cheap, and many of them are damned fine. Here follows the nitty gritty. 

A neighborhood of a point a is the set of all points x such that the distance d(x, a) < 5, where 5 
is any given positive number. For the real number line, the distance is defined as |x — a\ < 5, If you're 

on the place we'd have d(x, y) = <J(x 2 — x x ) 2 + (y 2 — yi) 2 . If you're on the surface of a sphere you'd 
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have the formula for distance on a sphere, etc. (This concept of distance, norm, or metric, is not stuck 
to formulas based on the Pythagorean distance. Physicists use LP norms in quantum physics.) 

A deleted neighborhood of a point a is the set of all points whose distance from a is less than S, 
but excluding the point a itself. On the real line this would be < \x — a\ < S. 

A point a £ S is an interior point of S if there exists a 5 neighborhood of a all of whose points 
belong to S, e.g., 1 is an interior point of (0,3). 

A set is open if each of its points is an interior point, e.g., (0,3). 

If there exists a 5 neighborhood of a all of whose points belong to S (the complement of S) then 
a is called an exterior point, e.g., {(-co, 0], [3,oo)} is the complement of (0,3). Any point in the 
complement of (0,3) is an exterior point. 

If every S neighborhood of a contains at least one point of S and at least one point belonging to 
S then a is a boundary point. For (0,3) the boundary points are and 3. Every neighborhood of 
"penetrates" the interior and exterior of (0,3). Ditto 3. 

The set of exterior points of S is called the exterior of S and the set of boundary points of S is 
called the boundary of S. 

A point a £ S is an accumulation point or limit point of S if every deleted 5 deleted 
neighborhood of a contains points of S. LetS = [l>^< ■■■]■ Every deleted neighborhood of contains 
points of S, so is a limit point of S, the only limit point in fact. 

A set is closed if it contains all of its limit points, e.g., [0,3] is a closed. The limit points are ,3. 

Now we can get to two big theorems we will use. 
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Theorem 1. The union of any number (possibly infinite) of open sets is open and the 
intersection of a finite number of open sets is open. 

Theorem 2. The union of a finite number of closed sets is closed and the intersection of any 
number of closed sets is closed. 

The proofs of these theorems are easy to find; it's well worth your time. The take away is what 
these theorems forbid. For the first theorem, you can't have an intersection of an infinite number of 
open sets result in an open set. For the second theorem, you can't have an intersection of an infinite 
number of closed sets resulting in a closed set. We have a few more definitions left. 

The set consisting of S together with its limit points is the closure ofS, denoted S. 

A set C of open sets (open intervals) is an open covering of a set S if every point of S belongs to 
some member of C. If / c S is an open covering of S then / is an open subcovering of S. 

( Big one here .) A set S is compact if every open covering of S has a finite subcovering. For the 
real line this is equivalent to being closed and bounded, e.g., [0,3]. Ditto for R n . Getting ahead of 
ourselves, the continuous group of rotations of the circle e Wl ■ e l ° 2 = e l01+02 is compact on the interval 
[0,27r], but the group of translations d x is noncompact. 

We now need to define a topological space and a differentiable manifold, before finally starting 
to connect to the continuous Lie groups we learned about in Part I. This crap will be pinned down with 
concrete, accessible examples. 

If X is a nonempty set, a class 7 of subset of X is a topology of X iff T satisfies the following 
three axioms: 

Axiom 1: X and T belong to T. 
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Axiom 2: The union of any number (possibly infinite) of set of T belongs to T. 
Axiom 3: The intersection of any two sets of T belongs to T. 

The members of 7 are then called IT-open sets (or simply open sets), and {X, T) is a topological 
space. Can you see how this definition of a topology has been ripped off from the real number line? 
Yes. The real number line is a topology. But so are weird things like X = {a, b, s, d, e) with T x = 
{X, 0, [a], {c, d), {a, c, d}, {b, c, d, e}}. T x satisfies all of the three axioms, hence T x is a topology on X. 
Now consider T 2 = [X, 0, [a], {c, d}, {a, c, d], {b, c, d}]. T 2 is not a topology on X because {a, c, d} U 
{b, c, d} g T 2 . T 3 = [X, 0, {a}, {c, d}, {a, c, d}, {a, b, d, e}) is not a topology on X because {a, c, d} n 
{a.b.d, e}<£T 3 . 

In this terminology then, an open set S p containing p is called a neighborhood of p. Symbolically 
we write p G S p £ T. 

A Hausdorff space, separated space or T 2 space is a topological space in which distinct points 
have disjoint neighborhood's. This is a concept of separation. The real line is a Hausdorff space. Any 
Euclidean space is a Hausdorff space. For any two distinct point on the real line I can always find tiny 
enough neighborhoods for each point such that these tiny neighborhoods don't touch each other, e.g., if 
my two points are 0.000001 and 0.0000011, 1 can "wrap" 0.000001 in the neighborhood 
(0.00009,0.00000105) and I can "wrap" 0.0000011 into the neighborhood (0.00000107,42), which are a 
pair of disjointed neighborhoods. 

(Updated, alternative definition of compact space): A space T is compact if every infinite 
sequence of points i u i = 1,2, ... contains a subsequence of points that converges to a point in T. (This 
involves the Axiom of Choice; mathematics is screwed because of the Axiom of Choice (see 
"Mathematics, the loss of certainty," by M. Kline.)) 
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A differentiable manifold /i is 1. Hausdorff (T, X) and 2. A collection <J> of mappings (our Lie 
symmetry transformations) p £ <t> 3 (such that) 

[A : <p p is a 1-1 mapping of an open set T p (p £ Tp) into an open set in BP. 

fi 2 :UT p =T. 

fi 3 : If T p n T q 0, P (^, n ITq) is an open set in R n and 0q(T p n T q ) is an open set in R v 
3 </> q (T p nT q )*<l) p (T p nT q ). 

fl 4 : (Maximality) p ° 0q 1 and <fi q ° 0p 1 £ O. 

The big idea here is to be able to work with the neighborhoods of some potentially ugly or weird 
space (say the surface of a torus, the surface of a Mobius strip or Klein bottle, {X, T) of our example 
with the sets being letters, etc.) and map it smoothly onto small neighborhoods in Euclidean space R v 
which is much easier to work with. In our case the spaces which we will be mapping to MP are the 
spaces made up from ^-dimensional continuous Lie groups, e.g., the symmetry group so(3) (for some 
ODE or PDE) being mapped (locally) to 1R 3 . Don't forget this mental picture . To remind ourselves of the 
tie to differential equations, let me cut and paste from the Hydon text the following definition of a 
continuous local Lie group. 

Suppose that an object occupying a subset of R v , say a solution to an rj th order ODE, has an 
infinite set of symmetries T E : x x i-» ^(x 1 ^ 2 , ...,x^; £), s = 1, ... ,n, where £ is a real-valued parameter, 
and that the following conditions are satisfied: 

(LI) T is the trivial symmetry, so that x s = x s when s = 0. (Identity) 

(L2) T £ is a symmetry Vein some neighborhood of zero (a point arbitrarily near zero). 
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(L3) ) T 5 T £ = r 5+£ V £ sufficiently close to zero. (Closure) (Here the binary operation 8 * s means 
adding the parameters S + s.) (We usually think of these parameters being small, near zero.) 

(L4) Each x s may be represented by a Taylor series in s (in some neighborhood of s = 0), and therefore 
^(^^....xV) = x s + e<f s (x\x 2 , ...,x T i) + 0(£ 2 ), s = 1, ...,77. 

Then the set of symmetries T E is a one-parameter, continuous local Lie group. The term "local" refers to 
the fact that the conditions need only apply in a neighborhood of s = 0. The term group is used 
because T £ satisfies the definition of a group. 

In slightly more jazzed up language, an jy-parameter topological group (or continuous group) 

consists of 1-An underlying jy-dimensional manifold /i. 2-An operation mapping each pair of points 

(/?, a) in the manifold into another point in the manifold. 3-ln terms of a coordinate system around 
y, /?, a, we write 

7^ = 0^(/? 1 ^.a 1 a"), 

where [i = 1,2, r\ 3 

0: /? x a -> y = /3a is continuous, 

x/j-.a^ a -1 is continuous. 

In this definition we are concerned about mapping a pair of elements of a continuous Lie group into a 
third element of that continuous Lie group by the group operation. 

Stop and think about this mental picture. We know from Part I that there are ODEs and PDEs 
whose Lie symmetries (extracted by the linearized symmetry condition) happen to be the continuous Lie 

group so(3): X x = yd x — xd y , X 3 = ^(1 + x 2 — y 2 )d x + xyd y , X 3 = xyd x + ^{—x 2 + y 2 )d y . The 
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commutator algebra of this three-parameter continuous Lie group is the same as the Lie algebra SO(3) 
defined by the three matrices 



10 

cos0 — sin0 
sin0 cos0 



costp sirup 

10 
— sm\p cosip 



cos 6 — sin 6 
sin 6 cos 6 
1 



which is the symmetry group of the sphere. "Coming from the left" are differential equations leading to 
the extraction of continuous Lie groups with the same commutator algebra as topological objects like 
spheres "coming from the right". We are beginning to see the relatedness of differential equations, 
abstract algebra and topology and (differential) geometry {why do we teach these subjects so 
disjointedly and so dryly with unintuitive abstract mathematical "Psychobabble"? If we must, let 
abstraction come after a unified foundation). 

Given 50(3), the definition of a continuous group is about doing, for example a continuous 
rotation by followed by a continuous rotation by if) with the result being an element of the group (the 
sphere is invariant under rotations). It's generally easier to work with matrix representations of a 
continuous group than with differential invariants. 

If the association between so(3) and SO(3) were unique life would be simple, but there are 
other realizations for the former, and other representations for the latter with the same commutator 
algebra, e.g., SU (2), the set of 2 x 2, complex-valued unitary matrices with determinant 1, has the 
same commutator algebra as SO(3). When the underlying topologies of the continuous groups are the 
same, we may transform from one representation to another by a similarity transformation. If the 
global topologies are different, the representations (even though they have the same commutator 
algebra) are topological^ inequivalent. (By the way, changes in global topology cause observable 
physical effects— see Bohm Aharonov effect.) 
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Let me give you a flavor of the difference between local and global topology. A topological 
object with SU(2) symmetry is as different as the sphere with S0(3) as the surface of the sphere is 
different than the plane generated by translations d x , d y , an issue of global topology. Walk straight 
along the equator of a sphere and you will return to your initial starting position. Clearly this does not 
happen if you're on an infinite two-dimensional plane. Up to point set topology, LOCALLY a small patch 
of the surface of a two-dimensional sphere looks like a little patch of the plane, an issue of. The 
mathematics of Sophus Lie is local in this sense. The trigonometric functions are linearized in Taylor 
series: sin 9 « 0and cos 8^1 when 9 « 1. A little more structure and we'll get to an example that will 
feel like an example from Part I. 

In a topological (continuous) group, /i we have: 

= a), a,/3,yefi (closure) 

<p^(y, 0(/?, a)) = 0^(0,(7,/?)) (associativity) 

M (£, a) = a M = M (a, s) (identity) 

M (a, a -1 ) = £ M = M (a _1 , a) (inverse) 

Part I taught us about continuous groups of Lie transformations. Continuous groups of Lie 
transformations are special cases of continuous groups of transformations. A continuous group of 
transformations is (a) An underlying topological space T v , which is an jj-dimensional manifold together 
with a binary mapping <fi: T x T -> T . (b) A geometric space G N , which is an N-dimensional manifold, 
and a mapping f:TxG^>G which obey postulate (a'): namely that T v , <fi obey the postulates of a 
topological group, and postulate (b'): The function y l = /'(a 1 , ... , a v ; x 1 , ... , x N ^ is continuous with the 
following additional properties: 
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Closure: aET, xEG => ax x E G => y l = f l {a 1 , ...,a r, ;x 1 , ...,x N ^ E G N , 



Associativity: /?(ax) = (/? ° a)xx E G => /'(/?, f(a, x)) = / l (0(/?, a),x), 



Identity: 



£X = x => x) = x\ 



Inverse: a 1 (ax) = a(a 1 x) = (aa - 1 ) = x => /'(a 1 ,f(a, x)) = f l (a,f(a 1 ,x)) 
= / E (0(a, a _1 ),x) = x'. 

A continuous group of Lie symmetry transformations is a continuous group of transformations acting on 
itself (G = T, f = 0). 

Example 1— Two-parameter group of collinear transformations of the straight line R x consisting of 

(a) Those operations which change the length of the basis vector. 

(b) Those operations which shift the origin. 

(c) That operation which changes the orientation of the basis vector (by reflection). 

If p is any point in R x , then wrt to some coordinate system S with basis e 1( it has coordinate x(p). Then 

under (a), a stretch of the basis e 1 — > (l/a 1 )e 1 by a 1 > 0, the coordinate p is multiplied by 

a 1 : x'(p) = a 1 x(p). The point P doesn't move; it's invariant. Only its description changes wrt the basis. 



(a) 



S' 



x(p) 



e'=(l/a)e, 

— ' M 



x'{p)= a x(p) 



Under (b) a motion of the origin from to - a 2 , the coordinates of p becomes x'(p) = x(p) + 



(b) 



P 

-•- 



x(p) 



S' 



■a 



x'[p)= x{p)+ a 
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Under (c) a reflection of the basis vector e 1 , the coordinate of p becomes x'(p) = — x(p). 



(c) 

s 



S' e\ 



x(p) 



p 



x'{p)= -x{p) 



Now let's take the pictorial two-parameter group of continuous transformations a 1 £ E\0, a 2 £ E and 
use all of our fancy definitions. Let the operation 0(a 1 , a 2 ) of the group {a 1 , a 2 } by defined on the 
coordinate x(p) by x' = a 1 x + a 2 , a 1 0. The underlying topological space !T 2 for this group is the 
plane M 2 excluding the linecr 1 = because we defined e x — > (l/a 1 )e 1 . (When we move to the global 
properties of this continuous group of transformations, the removal of the line a 1 = from the plane 
R 2 will have a deep impact; the space isn't simply connected (not unlike in the Aharonov-Bohm effect)). 
The geometric space on which our two-parameter group acts on G x is our line R 1 . I keep saying the 
"group fa 1 , a 2 }, but I have not yet defined the actual rule of the binary operation 0(a 1 , a 2 ). We now 
have enough information to determine it. The function / is given by f{a 1 a 2 ; x) — > a x x + a 2 . The 
function <fi is determined from the group multiplication: 

x" = /C/? 1 /? 2 ; x), x' = f{a x a 2 ; x) 

leads to 

x" = /?V + /? 2 = ^(o^x + a 2 ) + /? 2 =/(/? 1 a 1 ,/? 1 a 2 +/? 2 ;x), 

so, 

(fitf 1 P 2 , a 1 a 2 ) = 0? 1 a 1 ,/? 1 a 2 + (I 2 ). 
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Now let's check all of the conditions of our fancy definitions for a continuous group. For our example, T 2 
is a manifold since each half-plane (the half-plane to the left of a 1 = 0, and the half-plane to the right) 
can be mapped 1-1 onto a part of M 2 . From 0C/? 1 /? 2 , a l a 2 ~) = (/? 1 a 1 ,/? 1 a 2 + /? 2 ), we identify the 
coordinates of 

1 = pa 1 , 

02 = (/?,«) = + /? 2 . 

Both 1 and 2 are continuous. Let's check: 

Closure : 0(/?, a) £ T 2 and /J 1 * 0, a 1 * => 1 = /? 1 a 1 * 0. We did this last check because, 
recall, T 2 excludes the line with first coordinate zero. 

Associativity : 0(y, 0(/?, a)) = 0(y\ y 2 ; pa 1 + /? 2 ) = O 1 /? 1 " 1 * y x fi x a 2 + 7 1 /? 2 + y 2 ) = 
0(K 1 /?\k 1 /? 2 +7 2 ;a 1 ,a 2 ) = a). 

Inverse: (aV 2 ;^,-^) = (1,0) = - ^; a 1 , a 2 ). 

We have to similarly check the postulates for a continuous group of transformations. Clearly 
G x = i? x (our line) is a manifold and f{a 1 a 2 ; x) = a 1 x + a 2 is continuous in all of its arguments, and / 
obeys 

Closure : f{ax) £ R ± . 

Associativity : /(0(/?,a),x) = /(pa 1 + /? 2 ; x) = pa>x + pa 2 + /? 2 = /(/J 1 ,/? 2 ; a 1 x + 
« 2 ) = /(/?. /(«,*))■ 

Identity : /(l,0;x) = x. 
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Inverse : f f4r, — — r; « 1 x + a 2 ] = x. 

1 Va 1 a 1 J 



We may rewrite all of this structure into matrix representation form with the 1-1 mapping of T 2 
into 2x 2 nonsingular matrices 



Then 



MiXo 1 a 2 )o=( alx r 2 ) 

r 2 W/? X ^Va 1 a% /^a 1 /? 2 \ 

r '\o o/ vo oAo o/ V o 1/ 

We'll see that matrices will have their advantages. Back in the algebraic form, x -> x' = a 1 x + a 2 . 
What happens if we do this twice (square it that is): (x') 2 = (« 1 x + a 2 ) 2 = (a 1 ) 2 x 2 + 2a 1 a 2 + (a 2 ) 2 , 

In general, 

w 

(x') 2 -» (a 1 * + a 2 ) w = ^ Q (a 1 ) r (a 2 ) Af - r x r . 

r=0 

If Ms a positive integer, the N + 1 homogeneous polynomials (x w , ... , x, 1) can be used as basis 
for an (N + 1) X (N + 1) matrix representations of this projective group. These matrix representations 
are all faithful (1-1). If N were real, the representations are oo dimensional, e.g., here is a faithful 4x4 
representation (please refer to Gilmore's Dover text chapter 3). 



(a 1 ) 3 licence 2 ^(a 2 ) 2 (a 2 ) 3 ' 

i ^ _ [ (a 1 ) 2 2a 1 a 2 (a 2 ) 2 

a 1 

1 



(a 1 , a 2 ) 
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Quick linear algebra review— This two page review goes well with our picture example. (Think 
first year physics and/or calculus III.) A linear algebra is a collection of vectors v 1( v 2 , ... £ V, and a 
collection fi,f 2 , ■■■ G F, a field together with (a) vector addition, +, (/?) scalar multiplication, (t) vector 
multiplication □ 3 postulates 

[A] V(, Vj G V => V; + Vj G V (closure under vector addition) 
V; + (v ; - + v k ) = + vj) + v k (associativity) 

Vj + v = Vi = v + Vj (additive identity, v ) 
Vj + (-V;) = v = (-V;) + V; (additive inverse) 

[B] ft G F, Vj G V => fiVj G V (closure under scalar multiplication) 
fi ° (//' ° v fe) = (fifj) v k (associativity of scalar multiplication) 

1 ■ Vj = Vj = Vj ■ 1 (scalar multiplicative identity) 

ft (v k + v k ) = fi°v k +fi° Vj; {/j + /;} o Vfe = /; o Vfe + / 7 - o Vfe (bilinearity) 
STOP HERE and we have the definition of a linear vector space, but let's keep going to [C]. 

[C] l,v 1 ,v 2 G V=>v x Qv 2 G V 

(v-l + v 2 ) □ v 3 = v x □ v 2 + v 2 □ v 3 ; v x □ (v 2 + v 3 ) = v x □ v 2 + v x □ v 3 (bilinearity) 

STOP HERE and we have a linear algebra. 

We can add additional postulates "[D]" but this will lead to different types of algebras. We can 
add the postulate that v x □ v 2 = v 2 □ v x or the postulate that v x □ v 2 = -v 2 □ v x . Clearly these are 
mutually inconsistent choices. But what would motivate adding one of the above choices over another? 

148 



In vector calculus, if we let □ = x, we know the vector cross product: v x x v 2 = — v 2 x v lt hence we 
might choseVi □ v 2 = — v 2 □ v x and be done with it, BUT there are other types of important linear 
algebras. The set of real-valued, n x n matrices is a linear algebra under matrix addition and scalar 
multiplication by real numbers; that is, it satisfies postulates [A], [B] and [C]. If we adjoin the usual 
definition of matrix multiplication by letting □ be defined by 04 □ B) ik = Y^^^ij^jk tne space 
becomes an associative algebra, the identity element being (l) ik = S ik . We're about to run into 

problems. If we restrict ourselves to the set ofnxn real symmetric matrices obeying (Sij) t =Sji = 
+Sij, where the t stands for matrix transpose, then we can't use normal matrix multiplication because 
the product of two symmetric matrices is not generally symmetric. That is, if matrices A, B are n x n 
real symmetric matrices, then generally 04 □ B) ik = Y^^^ij^jk ^ rea ' symmetric matrix. If we define 
□ by anticommutation, A □ B = {A, B} = AB + BA we get a linear algebra, and A □ B = BA. So for 
these objects we have to choose postulate v t □ v 2 = v 2 □ v x . For objects that are n x n real 
onf/symmetric matrices A t = —A, A t j = —Aj U the operation □ must be defined by [A, B] = AB — 
BA = -[B,A], our old friend the commutator . If we add [A,BB + yC] = B[A,B] + y[A,C], we have a 
(matrix) Lie algebra! It obeys the (matrix) Jacobi identity [j4, [B, C]] + [C, [A,B]] + [B, [C,A]] = 0. So 
the nature of the object determines our choices for the additional postulates [D]. 

In example 1.4 we looked at a change of basis. In general terms we have a vector v = X v l e t in 
coordinate system S. Changing coordinate systems to 5" we have 



We may drop the summation symbol, the addition being implicit. Notice the matrix A is on the left of 
the basis vectors. We say basis vectors transform in an covariant way. On the other hand 
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where I only added the parenthesis for visual effect. We see that the matrix A is to the right of the 
vector components v' J . Thus we say that vectors transform in a contravariant way. Summing up 



e' = Ae, v = v l A. 

We have, effectively, two bases, a "dual basis" in linear algebra, and it helps us define the dot product. 
Basis vectors with low indices, e; transform covariantly, while basis vectors e 1 transform 
contravariantly. This structure is essential for special and general relativity: 

il \ /b°\ 
a -b = (a°,a\a 2 ,a") ° ^ ^ M^A = a°b° - - a 2 b 2 - a'P, 

\0 -l/\b 3 / 

where the 4x4 matrix is the metric of special relativity (the Minkowski metric). We bury this structure 
of the dot product in ordinary, 1 st year calculus based physics because the metric tensor is the identity 
matrix. 

There are five more definitions to go in this chapter, but they will have context thanks to our 
example 1. (Gilmore's Dover text gets into how to discover most of the global properties of a 
continuous group from its properties near the origin). 

A local continuous group is a manifold M together with a binary operation which is defined 
on certain points /?, a £ M (in particular, in a neighborhood of the identity) with the properties 

1- y = 0(/?, a) £ M when a) is defined, and <fi is continuous where defined. 

2- a -* a -1 is continuous when defined. 

3- When (p(y, /?) and 0(/?, y) are defined, <p[(p(y, /?), a] = <p[y,(p(l3, a)] if defined. 

4- There is an identity element s 3 <fi(e, a) = <p(a, s) = a £ M . 
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5-lfa 1 is defined, then 0(a, a x ) = 0(a 1 ,a) = s. 

These are the properties of a neighborhood of the identity £ of a continuous group. Warning: Since 
multiplication and inversion may correspond to points outside the neighborhood of s, then 
multiplication and inversion are not defined in such a neighborhood. It is not always true that a local 
continuous group can be embedded in a global topological group. 

Two local continuous groups (M, 0) and (M ' , 0') are locally isomorphic if (1) there is a 1-1 
mapping >f -> M', (2) If a,/? £ M and If a',/?' £ M ', then a ° /? and a -1 are defined iff a' ° /?' are 
defined. In addition, the manifold isomorphism must preserve the group operation (a ° /?)' = a' ° /?'. 

As I pointed out in a previous discussion, local continuous groups and local Lie groups arise 
when we linearized the group structure, e.g., the trigonometric terms in the rotation group S0(3) being 
linearized, sin 8^6, cos 8*1. We are investigating the properties of the group only near its identity. 

We will have occasional use for local compactness. A space is locally compact if, around and 
point p a neighborhood can be found whose closure (the neighborhood with its boundary, all its limit 
points) lies within the set. Our example is locally compact. 

Lie groups. Let a = s be the identity and let ft be some other point in the connected 
component of a continuous group (the part of the group where any two points can be joined by a line). 
Then e and /? can be joined by a line lying entirely within the connected component. Choose points 

on the line with the following properties: 

l-«i and a i+1 lie within a common neighborhood. 
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2-a i+1 o a" 1 lies inside some neighborhood of the identity s of the identity s for each value of i. This 
can always be done with a countable number of group operations a. Then the group operation /? can be 
written 

P = a m ... (a 3 o aj 1 ) ° (a 2 ° 1 )(a 1 ° a^ 1 ) ° s. 

Plainly, /? is a product of group operations near the identity. We are interested in studying the function 

0(a( +1 ,a~ 1 ) = 0(a; + 8a, a" 1 ) 

with small S — think Taylor series expansion. Then we must demand that be differentiable. 

A Lie group is the connected component of a continuous group in which the composition 
function is analytic on its domain of definition. (Hilbert's fifth problem showed that the requirement 
of analyticity is unnecessarily stringent.) Lie groups of transformations and local Lie groups are similarly 
defined. 

We are now going to start moving fast towards tying Lie's three theorems with the symmetry 
methods for differential equations we learned about in Part I. The divorce between differential 
equations and algebraic topology (of which we've only done local algebraic topology) could happen 
because Lie groups and Lie algebras have a mathematics of their own. Lie's three theorems provide a 
mechanism for constructing the Lie algebra of any Lie group, instead of us sloppily manhandling all of 
the possible commutators of all of the symmetry generators. The theorems also characterize the 
properties of a Lie algebra. More than that, I will show you that this mathematics underlies our general 
relativity (and other theories of gravity) and quantum fields (the ones we know of and the ones we 
invent). We will be working with and developing a practical example very quickly this time. 
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Let F(p) be any function defined on all points p £ G. Once we choose a coordinate system in G, 
we can assign each point p an N-tuple of coordinates: 

p (in coordinate systems) — > x 1 (p),x 2 (p), ...,x w (p). 

The function F(p) can then be written in terms of the parameters x'(p) in coordinate system S: 

F(p) = F s [x 1 (p),x 2 (p), ...,x w (p)]. 

In some other coordinate system S' the coordinates of p will change. Therefore the structural form of 
the function must change to preserve the fixed value at point p 

F(p) = F s '[x ,:L (p),x' 2 (p), ...,x' w (p)] 

How do we determine F s '\f we know F s ? The two coordinate systems S and 5' in G are related by an 
element of the Lie group of transformations 

x' ; (p) = f J [a,x(p)]. 

We already know F s in terms of x(p). To know F s ' in terms of x'(p) we must solve x(p) in terms of 
x'(p): 

x(p) = / l [a _1 ,x'(p)]. 
Then the complete solution to our problem is 

F s '[x'\p),x'\p) x' w (p)] (1) 

= F s [f 1 (a- 1 ,x'(p)),f 2 (a- 1 ,x'(p)) f N (a-\x'(p))]. 

This solution is not very useful. Great simplification happens if we stay near the identity. For a Lie group 
operation Sa^ near the identity 0, the inverse given by (<5a -1 )^ = —Sa^. We can then write the 
coordinates x ; (p) as follows 
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xKv) = f'KSa-^.x'ip-)] = fj[-8a^,x'(p)] = f J [0,x'(p)] + 



dfj[p,x'(p)] 



= x'\p)--Sa^ 



dfj[p,x'(p)] 



(Sal 1 ) + 



When this solution for x(p) in terms of x'(p) is used in (1) we get 



F s '[x'(p)] = F s 



x' J (p)-8a>* 



dfi\fi,x'( V )} 



= F s [x'(p)]-Sa^ 



dfJ[p,x'(p)] 



/?=o 



dx 



To lowest order the change in the structural form of F is 



F s '[x'(p)]-F s [x'(p)] = Sa4- dfJW ' o X '} P)] 



/?=o d x 



- \F s [x'(p)] = Sa^Wm 



where 



dfj[p,x'] 



/?=o ux 



are the infinitesimal (Lie) generators of infinitesimal displacements of coordinate systems by Sa^, or 
simply generators. Finite displacements are obtained by repeated applications of the generators. 

Whoa! In Part I we applied the (prolonged) linearized symmetry condition to differential 
equations leading to (tangent vector) Lie symmetries from which we then constructed the notion of Lie 
generators, but even in Part I we noticed the tendency of divorce between differential equations and Lie 
groups and Lie algebras. We found an ODE and a PDE with symmetry group S0(3). The present 
approach to Lie generators (which I learned first) seems more fundamental: change coordinates, 
linearize, get Lie generators/tangent vectors versus get arbitrary differential equations, apply linearized 
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symmetry condition, find tangent vectors/Lie generators. But why should this be so. Maybe because 
differential equations seem to be pulled out of a giant zoo with no a priori relation to any other 
differential equation, but does any transformation have anything a priori to do with any other 
transformation? 

Example 2— Recalling (f:TxG^>G), from example 1 we had f 1 {a 1 , a 2 ; x) = e al x + a 2 . This 
mapping works on T x G no matter what the label of x, e.g., f 1 {a 1 ,a 2 ; x') = e al x' + a 2 . 



df(a,x') 

*!(*') = - 

da 1 



a=0 



dx' X dx' 



X 2 (x') = 



df(a,x') 



a=0 



9 9 
dx' dx'' 



Suppose we have a function in S that is = (x — c) 2 . Under a displacement of the origin defined by 
x' = x + Sa 2 the structure of (x — c) 2 becomes {/ + 5a 2 X 2 (x')}(x' — c) 2 = [x' — (c + <5a 2 )] 2 . 







s 


c 


S' 


2 

c+6a 



e = 



S' 




-al 

e 




-al 

e c 



Let's do this in detail for the left hand figures. We have S' is related to S by x' = x + Sa 2 . We want to 
determine the structure of the transformed function. For this simple example, we know it should be 



?s' - r v < 



(x' -c-Sa 2 y. 



Let's check this by going through the mathematics. We had 
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F s '[x'(p)] = \sa^\l- 



dfi\fi,x'{ V )} 



p=o dx' J 



F s [x'{p)] ={l + 5a%]F 5 [x'(p)]. 



Working with the right equation (remembering that we drop powers of (5a 2 ) 2 or higher since 5 2 is 



smal 



I - Sa 2 —J (x' - cf = (x' - c) 2 - 28a 2 (x' - c) 
= x' 2 — 2x'c + c 2 — 2Sa 2 x' + 2Sa 2 c 

= (x + Sa 2 ) 2 - 2(x + Sa 2 )c + c 2 - 25a 2 (x + Sa 2 ) + 28a 2 c 

= x 2 + 2Sa z x + {5a 2 } 2 - 2cx - 2cSa i + c 2 - 2Sa^x - 2(Sa 2 ) 2 + 2cSa^ 

= x 2 - 2cx + c 2 = (x - c) 2 = (x' - c - Sa 2 ) 2 = (x' - (c + Sa 2 )) 2 . 

Let's now run this work for the right hand figures. We have x' = xe a \ 

F s '(x') = {I + 5a 1 Z 1 (x')}(x' - c) 2 = jl - 8a 1 x' (x' - c) 2 = (x' - c) 2 - 2x'(x' - c)Sa 1 

= x' 2 - 2cx' + c 2 - 2x' 2 Sa 1 + 2cx'Sa 1 = x' 2 (l - 25a 1 ) - 2cx'(l - Sa 1 ) + c 2 
= (e- Sa \' -cf. 

Is this a stretch? To first order, e~ 5al ~l - Sa 1 . Then (e- 5al ) 2 ~(l - Sa 1 ) 2 = 1 - 25a 1 + 
(5a 1 ) 2 ~l — 25a 1 . Then, going back to the penultimate result, we have 

F s \x') = {I + 5a 1 Z 1 (x')}(x' - c) 2 = x' 2 (l - Sa 1 ) 2 - 2cx'(l - 5a 1 ) + c 2 = (e'^x' - cf. 

I really can justify this "cheating". Let me show you. 

In the first case I got F s \x') = (x' — (c + Sa 2 )) 2 with x' = x + Sa 2 . If we're interested in 
finite displacements x' = x + a 2 , we merely have to exponentiate: 
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( a 2 ) N 
F s \x') = lim I + — X 2 (x')\ {x'-cf 

CO ^ 

= Y-, (a 2 X 2 (x')) n (x' - cf = e a2x ^ x '\x' - cf = e~ a V (x' - c) 

n=0 

= (l-a 2 -^j (x' - cf = (x' - cf - 2a 2 (x' - c) 



= x' 2 — 2x'c + c 2 — 2a 2 x' + 2a 2 c 

= (x + a 2 f - 2(x + a 2 )c + c 2 - 2a 2 {x + a 2 ) + 2a 2 c 

= x 2 + 2a 2 x + (a 2 ) 2 — 2cx — 2ca 2r + c 2 — 2a 2 "x — 2(a 2 ) 2 + 2cg a 

= x 2 - 2cx + c 2 - (a 2 ) 2 = (x - c) 2 - (a 2 ) 2 = ((x' - c) - a 2 ) 2 
= (x' - (c + <5a 2 )) 2 . 

Now for the second case, F s \x') = (e~ 5al x' — c) . Let's get the finite displacement. 

( a 1 ) N 
F s \x') = lim 1 + — Zi(x') (x' - c) 2 

JV->oo [ N J 

oo 

= V ^ r (a 1 Z 1 (x')) n (x' - cf = e alx ^ x '\x' - cf = e""^'^ 7 (x' - cf 



= e~ alx '^ r (x' 2 -2cx' + c 2 ) 



f - 9 1 „ , d 2 \, 2 

= 1-aV — + -(aV) 2 fx' 2 - 2cx' + c 2 ) 

\ dx' 2 V ax' 2 / v y 



= x' 2 - 2cx' + c 2 - 2a 1 x' 2 + (aV) 2 + 2ca 1 x' 

= (1 - 2a 1 + (a 1 ) 2 )x' 2 - 2c(l - a 1 )*' + c 2 = (1 - a 1 ) 2 *' 2 - 2c(l - a^x' + c 2 
= [(1 - a^x' - cf = \e~ a \' - cf. 

I can't do better. This liberty with the Taylor series of the exponential function pervades Lie theory. I'm 

I'd 1 2 

not 100% comfortable with it. The source author wrote e~ a x a^(x' — cf -> [e~ a x' — c] . 
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Infinitesimal generators for a Lie group. A Lie group of transformations acts on itself. With the 
identification: geometric space G N —* topological space T v , we identify: 

f(a,x(p)) -» <p(a,x(p)) 
F[x(p)] = Q\x(p)l 



It follows that the infinitesimal generators are 



df j W,x'] 



dp* 



dx" 



Since a Lie group acting on itself is a nonsingular change of basis, 



(2) 



det 



dcp\fi,x\v)) 



* 0. 



Example 3— Recall from example 1 that we can replace our group operation with matrix multiplication 
given the following mapping, 



Any other matrix with the same algebra works. In material that I have yet to present, I have a reason to 
switch the above matrix for 



This matrix works better for this example. With this new matrix representation we get 
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<PCP 1 P 2 ,x 1 x 2 ) = (l3 1 ,P 2 )°(x 1 ,x 2 ) = ( e '* 1 P)( e £ **) = ( 



Then 

<t> 1 iP 1 P 2 ,x 1 x 2 ) = P 1 + x\ 

2 (/? i /? 2 ^v) = ^v+/? 2 . 

(Please go back to example 1 if all of this notation is confusing; it checks. Also keep in mind where 
you're at— in the continuous Lie group of transformations. Then 



fdcp 1 d(p 2 \ 
dcp 1 dcp 2 

W W) B= 



0=0 



So, dropping primes, X^ix') = ~ 



— j, together with the matrix above yields 

p=o d x" 



fl_\ 
dx 1 
d 

\d~X 2 J 



_(1 X 2 \ d X' = ( X iOc)\ 
\0 l) d \x 2 (x)J 



Hence, 



Xiix) = 



dx 1 dx' 



Xiix) = - 



d X 2 



These are the generators of the continuous Lie group of transformations (IT) from the left because /J 1 /? 2 
are on the left in 
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How about f rom the right? ( x 1 X 2 are on the right of ${§ x fi 2 , j 1 ^ 2 ).) In other words interchange the 
roles of /? M with x" m equation (2) resulting in: 



Then, 



1 d(/) 2 \ 



dx 1 dx 1 
dcp 1 dcj) 2 



-C c ?0- 



x =o 



Thus from the right (with the X t as functions of the vector /? {J3 . ft ), 



\X 2 (B)J \Q e P) 





1 


9 \ 


dB 1 






d 








\ 





"On the left" we have the X t as functions of the vector xix 1 ^ 2 } whereas on the right, we have 
the Xj as functions of the vector fff/? 1 , /? 2 ). Order matters! Especially in physics! Thus there is a 
"relativistic" thing happening here. The group operation may be interpreted in two different ways. 
Either (A) the coordinates xiv) m coordinates system S are then given in 5" which is related back to S by 
X'(p) = 0(«, x(p))> OR (2), the coordinates a(p) in coordinate system S are given in 5" which is related 
back to 5 by B'(p) = 0(/?(p), x)- In (A) we have the left translation by /?. In (B) we have the right 
translation byj. 

Back in example 2 (with f:TxG^>G)we derived the generators in the geometric space (G): 



%i ( x = ~ x ' 4~f %2 (*') = ~~ 4~r There was no left or right in 
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W) = - 



dp* 



/?=o ux 



The x' ; £ G, while the /? M £ T. In IT, where the Lie group of transformations acts on itself, and we 
mapped 



dfJ\fi,x'] 



dp* 



r)r' J 
/?=0 ux 



d dcp\p,xl 



dp"- 



d 



both the P 11 and x' 1 belong to T. Hence in 7 we have a left and right translation. Differential equations 
live in manifolds G. Lie symmetries (topological groups) live in T. Here is the marriage: 



dfj[p,x'] 



dp* 



/?=o 



dx 



f] 



Here is the divorce: 



dfj[p,x'] 



dp* 



/?=o ux 



d^{P,x') 



dp* 



=o d X 



f] 



Ain't it a shame. 



Infinitesimal generators for matrix groups. Way back in Part I, I titillated you with 
exponentiating a matrix. The generators for matrix groups are defined analogously to how we've 
defined generators above. If M(a 1 , a 2 , ... , a v ) is an element of r x r matrices, we define the 
infinitesimal generators by 



XJr x r) = lim 



M(0,0, 0,0) -M(0,0,...,0) 



The r] generators constructed this way are bases for linear vector spaces since A^X^r x r) is also an 
infinitesimal generator: 
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WXJj x r) = lim 

^ T->0 



M(A t, A t, ...,A 7, t) - M(0,0, ...,0) 



The generators X^(x) and X^(x) are also bases for linear vector spaces, and the are all linearly 
independent since each group operation must have a unique inverse. 

Example 4— The generators for our 2x2 group of matrices are given by 



In this way we may construct the (N + 1) x (N + 1) faithful representation of this group with bases 

( V N yN-l v 2 „1 v 0\. 

X 1 = diagonal (jV,JV - 1, ...,1,0), 



/ 



X 



2(W+1)X(W+1) 



JV - 1 




V 



\ 



3 

2 



1 




/ 



Finally (as I showed you explicitly in part I), 



-^H; ?<-;-> 

w=o V 1 ' 
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Yet again we have another parameterization. This one is analytically isomorphic to ^ e ^ j because 

there is an analytic mapping between them (no proof; see Baker-Campbell-Hausdorff formulas). This 
leads to another study of Lie groups: how can we classify different Lie groups if even the same group 
may have more than one analytic structures describing the group multiplication? (Both and X must 
have the same local properties. Check them off from the definition and you show equivalence or 
inequivalence.) 

Commutation relations. In this section we peer into the deep underpinnings of general relativity 
and quantum fields. Recall the commutator: [A,B] = AB — BA = —[B,A], my old friend, the end. 
Recalling example 2, observe that 



[X 1 (x),X 2 (x)] = 
and "from the left" from example 3, 

[x 1 (x),x 2 0c)] = 

and from our matrix group, 



d d 
dx' dx 



d 2 d d 



dx 1 X d X 2 'd X 2 



d 



[X^N + 1),X 2 (N + 1)] =X 2 (N + 1). 

ALL realizations AND representations have isomorphic commutator relations. There must be a 
fundamental property of Lie algebras. What is the significance of the commutation relations? I've 
shown lots of physics cases. Here is the mathematics. If a and B are elements in a commutative 
(abelian) groups, then 

aBa- 1 = B. 
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If the group is not abelian, y measures the amount by which a/3a 1 differs from /?: 

a/?a _1 = yf3, 

where y is a group element because 

a/JC/Ja) -1 = y. 

The LHS is called the commutator of elements a,/3 in a group. WOW!!! In mathematics, 
noncommutativity forces us into the commutator (and the Bianchi identity) and so on). In physics, it 
distinguishes between classical and quantum physics. The commutator measures the degree of physical 
"entanglement"; the act of observing one of a pair of noncommuting observables leads to uncertainty in 
this other observable, e.g., position, momentum and energy, time. 

Now enters Sophus Lie. If a and /? are near the identity we can expand them in terms of 
infinitesimal generators (both physics and mathematics): 

1 

8a -» I + <5a% + - <5a%<5a v Z v + -, 

8p -» I + <5/?% + X - 8t3X^t3 v X v . + ■■■ 
Now forming the product (keeping things only to first order in Sa^ 1 and 5/?^, 

(a/?)(/?a) -1 = (i + <5a% + ^ <5a%<5a v Z v ) (i + <5/?% 

+ X - Spx^pxj) ^1 + 5/?% + \ SfiX^^X^ (i + <5a% + ^ <5a" X^X^j . 

Recall that in linearized regime (i + Sa^X^v) = I — Sa^X^v.... After lots of algebra which you 
know by now how to do, 
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{apXPay 1 = I + SaVSpvfaXv - X^) = I + [X^X^. 

The commutator exists in the vector space of group generators since (a/?)(/?a) _1 is a member of the 
group. Therefore the commutator may be expanded in terms of bases X^. 

The C^ v are the structure constants. We've seen use of the structure constants in Part applied to 
differential equations, namely to the classification of invariant solutions and their corresponding Lie 
symmetries. I also showed you in the first chapter of Part I (the motivational section) an application of 
structure constants to "extract" particle spectra. We will do both of these things again and again in 
latter portions of these notes. The structure constants completely determine the structure of a Lie 
algebra and almost uniquely determine the structure of the Lie group with that Lie algebra. 



Example 5— the BIG PICTURE! 



1 -tal 2. 

(-ta ,-e ta ) 



-i -i 



i 2 -tai a(3q (3 

(-ta , ta (1-e )) * >— ~ 

-i -i 
3a 3 




tal 2 

(0,(e -l)ta) 



a 



(0,-ta ) 



We're inside the continuous (or topological) group. Let a = (ta 1 , 0) and /? = (0, ta 2 ). Let's take the 
commutator of a and /?. (The outer "loop" has a larger t parameter than the inner "loop". 
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p a -ip-i = (1 ta ^ ^e~ tal -t« 2 e- tal j = ^e~ tal -t 2 a 2 e~ tal + ta 2 | 

Expand the exponential up to first order. 

^1 (e tal - l)ta 2 j = ^1 (1 + (ta 1 - l)ta 2 j = ^1 t 2 a x a 2 ^ 

We started at /? = (0, ta 2 ) and ended up at (o, t 2 a 2 (e tal — l)). If the algebra were abelian we would 
have ended up back at where we started, but this algebra is not commutative. Going around the 
"commutator loop" doesn't get back to where we started by a factor of (e tal — l). 

Differentiate the result wrt t 2 . 

Aside on Lie "binding" of classical and quantum physics 

(You probably need a bachelor's degree or higher in physics to get the full meaning of this aside. 
The physics gives context to the senior level mathematician.) We have all of the tools to take a deep 
look (in a nutshell) of the mathematics binding classical physics to quantum physics and Sophus Lie. 
We'll do a bonehead example. We build a Lagrangian £. If we are considering our old friend the spring- 
mass system, we it's £ = |mi 2 — \kx 2 . The principle of least action expressed in variational form (our 

calculus of variations) leads to the Euler-Lagrange differential equations of motion -^-^4 ~T~ = mx ~ 
kx = 0. This is an ordinary differential equation. Solutions of this ODE are sine and cosine functions. 
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The initial conditions let us figure out the arbitrary constants of the general solution of the ODE. There 
is a whole other way, however, of getting to the solutions than this Lagrangian Mechanics differential 
equations approach, namely, the Hamiltonian Mechanics approach. 



To this end, this is what Hamilton did. He assigned ^ = p, where p is the time derivative of the 
momentum p, and substituted ^ = p into the total differential of the Lagrangian £{x, p, t) to get: 

d£ d£ 
d£ = pdx + pdx + — dt = pdx + d{px) — xdp + — dt. 

at at 

Rearranging, he got: 

d£ 

d(px — £) — —pdx + xdp — — dt. 

at 

The term in the parenthesis on the LHS is what is called the Hamiltonian, "H. That is, "H = px — £. For 
our spring-mass system our canonical momentum is p = ^ = mx, where x is the speed dx/dt. Note 
that after rearrangement x = So the Hamiltonian for our spring-mass system is 

1 , 1 , p 2 p 2 1 , p 2 1 , 
K = px — £ = px — -mr — -/or = 1- -kx z = 1- -/cx . 

2 2m 2m 2 2m 2 

It happens in this case that K equals the total energy E, the sum of the kinetic and potential energy. 
Cool, but where are those solutions I've promised? Almost. We left off with 

d£ 

d(px — £) = —pdx + xdp — — dt. 

at 

With K = px — £, this changes the above equation to 

d£ 

dK = —pdx + xdp — — dt. 

at 
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By comparing to the definition of the total differential, 



dK dK dK 
dK = — — dx + — — dp + — — dt. 
dx dp ay 

Hamilton then made the following identifications (the canonical equations of Hamilton): 



dK _ dK _ . dK _ dl 

'dx~~~^' ~dp~~ x ' ~~dt~~~di' 

Here comes the solution to our spring-mass problem. At time t = let the initial position be 
x = x(0) and the initial momentum be p = p(0). First assume we already know the solution x(t) 
with Taylor series: 



oo 

*(o=2^* (n) (t)i t=to t n 

n-0 



Now pay attention and note the following pattern for our spring-mass system (then the light bulb will go 

^ d3~C d3~C t) 

on!): With (explicitly) K = 1- - /ex 2 , we have — = kx and — = — . If the function f is x, (and 

' v v " 2m 2 dx dp m I >\ 

clearly here x does not explicitly depend on t) the time evolution of x is given by 

d , , (dxdK dxdK\ p n 

x = -x = {x,K}(t = t ) = [—- — — = 

dt \dx dp dp dx J ^ m 

(No crap! From freshmen physics p = mi = mv and at t = 0, p = mx Hold your horses.) The time 
evolution of x then is 

N (dxdK §x dK dx- ) (P } 1 r , m 

x = {x,^}(t ) = {{x,Jf},^}= ——-_—+_ ,jf = \-,K\ =-{p,K(t )} 
L J I3x dp dp dx dt ), t ■> \ to ) m 



_ 1 (dp d K dpdK + dp\ _ 1 
m\dx dp dp dx ^\ to ) 171 ° 



(No crap again. We know mx = ma = kx. At t = 0, a = kx /m. Keep going.) 
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x = {x, Jf }(t ) = {{x, H], H}. t = \{{x, H}, H\ h] =\ x,h\ = {x, H} {to) = % 

(.to) i> J J (t ) l m J( to ) m u m z 

Keep going one more time: 

x« = {*, Jf}(t ) = ... = f--^, Jf) = U -^ L . 

( m 2 J (to) m 2 

The iteration is generating the terms x^(t)\ t=t . Nice!!! Let's plug in and see if we have 
enough terms to recognize two distinct Taylor series. The series for x(t) is: 



, , 1 , , Po k k z k z 

= -x(0) + —t - —x t 2 - —^p t 3 + —^x t 4 + ■■■ 
0! V.m 2\m 3!m / 4!m / 

(1 k 2 k 2 A po 1 1 /fc\2 _ 1 /fc\l 3 \ 

-^^O!' 1 2!^ £ + 4!^ £ J + V^ll!W 1 3!W £ + '"J' 



This is x(t) = x cos a)t + -=sin<yt, with w = ^k/m. We've solved -^-^4 — t~ = ^x — /ex = via 

\ TYIK (XX, OX OX 

Taylor series. We can write: 



Po ^ k 2 /c _ fe' 



x(t) = x(0) + — — t - — — x t 2 - — — 5-p t 3 + — — 5-x t 4 + ••• 
w w l!m 2!m 3!m 2K0 4!m 2 

= ^x(O) + I{x,^} (to) t + ^{{x,^},Jf} to t 2 + ^{{{x,^},^},^} t 3 + 



= \*™ {* im ' X] \t-t + e-'^lt-J + ^(^U - •"* Pf ' 1 U) 



What? You didn't notice the three faces of the exponential function back in example 2: 



(2 -\ N 
F s \x') = lim I + ^-Z 2 (x') (x'-c) 2 

JV->oo A/ J 

oo 

= ^ ^(a 2 Z 2 (x')) n (x' - c) 2 = e a2 ^( x ')(x' - c) 2 = e" a V (V - c ) 2 ? 



169 



In general for some K, what is — e 1 ^'^? 



(CO \ /CO _ v 

n=0 / t _ to \n=l / t _ to 

v n=l 't-t 



Let p = n — 1. Then 



oo oo 

n=l p=0 



Thus, alas, 



This is the classical physics version of the Schrbdinger equation. 

Turning physics to mathematics, if / is any function of x, p and t, namely / = f(x, p, t), then 

d dfdK dfdK df r df 

-dt f{x - P ' t) = ^-dp-^ + ^ = [f ' K} + ^ 

where [f, H] is the Poisson bracket. If / is any function of x and p, but does not explicitly depend on 

time, t, then ^ = and thus ^- = — {/, K } = {Jf, /}. (This was the case for the spring-mass problem, 

f -* x, and thus the function x didn't explicitly depend on t. Yet we generated x(t) via 
"exponentiation".) As we did with the physics example, let's pretend we know f(t). Its Taylor series is 



71=0 
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As with our physics example, now you can check that: 

/'(t )=/ (1) (to) = {/,^}(t ), 
/"(to) = f {2) = [f {1 \K] = {{f,H},H}(t l 
/'"(to) = / (3) = {f i3 \K} = {{{f,K},K},K}(t ) 

and so on, giving us f(t) = f(t - t ) Zn=o^{- {{f,H},H}, ... n timesj^Ct - t ) n = f(t - 

t )e( t-t °^ ,?f }. The exponential notation merely represents the series. We have generated f(i) 
explicitly in t. It follows as before that 



df(t) 



dt 



t-t a 



= _ e (t-to){/.W} 

dt 



t-t a 



t=t a 



Now to quantum physics and Lie's work. One historical approach from classical physics to 
quantum physics was found by assigning classical quantities to differential operators thusly, 



d d „ 

p x i— » —ih — = p x , x i— » x = x, and K = E i— > ih — = K. 
ox dt 



The hats denote differential operators. The Poisson brackets become Lie commutators. 



The classical Hamiltonian of our spring-mass system is 



1 , 1 , Px 1 , 
"K = E = -mv z + -kx z = 1- -kx z 

2 2 2m 2 



Classical physics has been transformed to the quantum physics Schrbdinger equation 



ih — ip(x,t) = 
at 



1 / d \ 2 1 
2m \ dxJ 2 



h 2 d 2 1 , 

ip(x, t) = ^—^-^4>( x > t) + -kx z ip(x, t). 
2m ox* 2 



As with our classical example, we can do quantum physics via another approach other than 
solving Schrbdinger's equation. To this point in the aside I've been fairly rigorous with the mathematics. 
I now proceed merely to outline the connection between quantum physics and Lie generators. (To do 
quantum mechanics you have to be up to speed on the linear algebra of unitary and hermitian matrices 
and operators.) Given that the Hamiltonian is the infinitesimal (Lie) generator of time translations there 
is a time evolution operator defined in quantum physics (developed by analogy to classical physics): 



iKdt 

t/(t + dt,t ) = 1 — 



Then in textbooks it is shown that 

U(t 2 , t ) = U(t 2 , tJi/Cti, t ), t 2 >t 1 > t . 
Together these two equations lead to 



iftdt\ 

U(t + dt, t ) = U{t + dt, t)U(t, t ) = ( 1 — J U(t, t ) 



Algebra leads to 

U(t + dt, t ) - U(t, t ) _ iftdt 
dt ft 

In the limit of small dt, we get Schrodinger's equation 



U(t, t ). 



d 

ih — U(t, t ) = KU(t, t ). 
at 

One then goes on in quantum physics considering Hamiltonians which do or do not depend on time. 

Did you note that — = for our classical (and hence quantum) Hamiltonian? In the spring- 
mass system the energy is a constant. It never changes. It is invariant under transformations of time 
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(the passage of time forward, or run backwards in a movie). The Hamiltonian is the infinitesimal (Lie) 
generator of time translations. Abstract mathematics, meet physical context. 

Historically, three different pictures, all equivalent, of quantum mechanics arose from three 
different points of view. In the Schrbdinger picture the state vectors (wave functions) carry time 
dependence while the operators stay fixed in time, in the Heisenberg picture is the opposite. In the 
interaction picture, both state vectors and operators share time dependence. We have seen how this 
can happen in the study of Lie groups and algebras. Are we dealing with the algebra here f:TxG^>G 
or here G? So some people developed quantum mechanics via Lagrangian mechanics, Hamiltonian 
mechanics, Hamilton-Jacobi action angle mechanics, Poisson Brackets. Richard Feynman used the 
Lagrangian in his (the fourth approach) path over histories formulation of quantum physics: 



Lastly, in quantum physics we see the smooth evolution of a smoothly spread wave function 
pertaining to, say, an electron orbiting an atomic nucleus. The iterated (or "exponentiated" Taylor 
series) approaches is more reminiscent to particle physics where particles can be created or annihilated 
(recall the ladder algebra we reviewed in the lagniappe). Each term in the series iterated by a small St 
can be seen as particles interacting among each other: an electron being annihilated by a positron, a 
photon thus being created, or the other way around, the photon splitting into an electron-positron pair. 

In quantum field theories, we speak of 2 nd quantization. With these notes, up to this point, you already 
have good unified, symmetry-based foundations in the underlying mathematics and physics. Shall we 
get back to business? End Aside . 




all paths 
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Brief aside for the advanced graduate student/postdoc in particles and fields. 

Recall the figure of example 5, of taking a round trip in the Lie group space in terms of the 
commutator, and recall that if the group is nonabelian, the commutator y measures the amount by 
which afia' 1 differs from /?: 

a/?a _1 = yf3. 

By taking a round trip in this context by parallel transport, and requiring local gauge invariance, Ryder's 
text (section 3.6) shows how the covariant derivative arises such that the commutator of the covariant 
derivative operators leads to gauge fields: (the are (vector) guage potentials) 

[D^.Dy] = [dp - igA ll ,d v - igA v ] = -ig^^Ay - dyA^ - i#[^,v4 v ]} = -igG^. 

Then he shows how this mathematics parallels the mathematics of general relativity, the quantity being 
analogous to the field tensor G^ v , the Riemann-Christoffel curvature tensor 

dk _ p, r K — pi r K 4- r p r K — r p r K 

I love step-by-step books. "Quantum Field Theory," 2 nd ed., L. H. Ryder, Cambridge, 1996 is a step-by- 
step introduction to QFT. I hope that these notes enrich your understanding of quantum fields and 
general relativity. Later, after I've covered algebraic topology dealing with global properties of 
symmetry groups, I'll have an aside on how mathematicians have generalized the concept of vector 
potential/covariant derivative with differential forms and connections on principle fiber bundles. 

Lie's first theorem. (Review examples 1 -3. Keep f:TxG^>G and G x G in mind; the Greek 
letters are elements of the continuous group 7 (jj-dimensional) they are the Lie symmetries for us. The 
coordinates x' l (p) are for the points p in the continuous geometric group G (N-dimensional). The 
coordinates system is relative to frame S. 

174 



x' l (p)=f i [a> i .x(p)], n = \,2 77, i = 1,2 JV 

is analytic (smooth; expandable in a Laurent (or Taylor) series) then 

dx' 1 df l [a,x\ 



K = l 



where u l K {x') is analytic. 



Proof. If we transform from coordinate system S— >5"— >S" , the coordinates of any point p wil 



change successively from x'(p) to x"(p) to x" E (p). Suppose /? is an operation near the identity, 
P = 5a. Then x'"(p) will be close to x"(p), and the difference 

dx" i (p) = x" i (p)-x' i (p) 

can be computed in two different ways: 

x a (p) = (x + dxy = f l [a,x], 

x "i(p) = (x' + dx'Y =f i [Sa,x'l 

The middle terms are differential translations in G. The right hand terms are group actions from 
f:TxG^>G. In terms of /, and in terms of the linearized Taylor translations, the equation for x"(p) 
leads to 



dp' 



Sa A = 8a A u\(x'). 



Clearly we've identified the u\{x') with the &f ^ ' I ■ Backing, 



'/?=o 
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(a + 8ay = ^(Sa.a) 



dp* 



Sa A = <5a A 0^(a), 



p=o 



where 0^(a) is a rj x jj nonsingular matrix identified with ■ Tne i nverse of 0^(a) is ¥(a). 



Therefore, 



This simplifies to 



9jf(a)V(a) = n = V(a)0^(a). 



5a** = da^ia). 

In terms of the displacement danear a induced by infinitesimal displacements Sa at the identity, the 
displacement dx' at x'(p) is given by. (The result for <5a^ is substituted into the equation for dx' 1 .) 



dx n = 8a x u[(x') = da^{a)u[(x') 



Differentiating wrt to results in: 



dx n 
dot 



= Y j ^icc)u\{x'). 



A=l 



Since f l (a,fi) and a) are analytic, 



/? = 
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3 " (a) = 



are also analytic. 

Example 6— (The theorem made concrete.) Sticking with examples 1-4, if a(a 1 , a 2 ) is a transformation, 
and 8a = (5a 1 , 5a 2 ) is near the identity, then 

x' = e al x + a 2 

x' + dx' = e 5a \ + 8a 2 « (1 + Sa^x' + 8a 2 

x' + dx' = x' + 8a 1 x' + Sa 2 

dx' = 8a 1 x' + 8a 2 

Since 8a ° a is near the a, we write (a + da) 1 * = 0^(5a 1 , 5a 2 ; a 1 , a 2 ). Recall from our previous 
examples that 1 = a 1 + 5a 1 , and <p 2 = e Sal a 2 + 8a 2 . So 

1 = a 1 + 5a 1 = (a + da) 1 => da 1 = 5 a 1 

2 = e Sal a 2 + 8a 2 « (1 + 5a x )a 2 + 5a 2 = (a + da) 2 => da 2 = a 2 5a x + 5a 2 . 

In matrix form, 

/da 1 ^ / 1 0\ Mah 
W 2 / W 2 l)\8a 2 '' 

Inverting and solving for 5a 1 , 5a 2 we get: 

Ma 1 ^ _ / 1 0\~ 1 fda 1 \_fl OWda 1 ^ 
\8a 2 ) W 2 !>/ W 2 ^ W iA da 2/ 
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Then dx' = Sa 1 x' + Sa 2 which is in G (Recall: f:TxG^>G) and the results of our solution for 
Sa 1 , Sa 2 which live in T as do da 1 , da 2 leads to 



Then 



dx' = x'da 1 + {-a 2 da 1 + da 2 ) 



dx' 
da 1 



= x' 1 -a 2 , 



dx' 
~da 2 



= 1. 



The formal expression 



dx a 
~dat 



can also be used to determine these differential equations: 



0» = 



fdcp 1 d(p 2 \ 

Jp 1 "dp 1 

dcp 1 d(f> 2 

\W W) B= 



/l a 2 \ 



ukx') = 



df3< 



(2L\ 



dp 1 
df 



Thus we have 



'dx'" 

da 1 
dx' 

(da 2 ' 



=G T)(i>e'r> 
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Sophus Lie decomposed partial differential equations into the product of two matrices, one depending 
on the transformation parameters and the other depends on the initial conditions x"(p). This is a 
generalization of the problem of finding solutions for systems of simultaneous linear partial differential 
equations with constant coefficients 

dx l 

which can be treated by standard algebraic (Part I) techniques. 

Lie's second theorem. The structure constants are constants. If are generators of a Lie 
group, then the coefficients Cft v given by the commutators [Z^,Z V ] = Cft v X_A are constants. Before 
proceeding to the proof, note this critical fact: The differential equations 



A=l 



do not always have a solution. The equations 



ds ' dt 



have not solutions for 



d dip d dip 

-=1*0= -. 

dt ds ds dt 

Note also that the necessary and sufficient conditions for the existence of a unique solution with 
initial conditions 

x n = f l [a,x]\ a=0 = x l 

is that all mixed derivatives be equal 
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d 2 x n _ d 2 x n 

da"da v ~ da v da^' 
These are called the integrability conditions. 

Proof. We apply the integrability conditions to the equation proven in Lie's first theorem 

i 71 

dx' df l [a,x] 



da x da x 

K = l 



This leads to 



3¥ v K (a) . duUx') d^tta) , . duUx') 



Rearrange this result to 



duUx') , duUx') d^ x {a) , d*¥%{a) . 



du 

Replace the terms — appearing on the left by 



du l K {x') _ dxi du^jx) _ dx> du^jx) _ . du l K (x) 

da* ~ dxi' da* ~ da*' dxi ~ c la ^ W ' dxi ' 



du\(x') dxi du\(x) dxi du\(x) s ,■ du\(x) 

d_ i — AV — A — u/o ( a ~) u > (V) 

da v dxi da v da v dxi j s k j Qxj ■ 



The rearranged equation becomes 

duUx) , . ,■ duUx) d"V x {a) . dV£(a) . 
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Changing k to 8 on the LHS, and A to k on the RHS (which is okay since we didn't lose any terms with the 
new labels 

The terms ¥(a) on the LHS can be moved to the RHS by multiplying both sides of the equation by the 
inverses of the ¥(a), namely the 0(a). This renders the LHS only a function of x. The LHS "lives" in the 
differentiable manifold G. On the RHS is almost only a function of a. The RHS is almost an animal living 
in T. The term u l K (x') is a function of x and cannot be moved to the LHS since it is an r\ x N matrix. 
We can circumnavigate this problem if we observe that these arguments hold for a Lie group of 
transformations. Isomorphic arguments hold for a Lie group. That is we can make the following 
identifications 

f\a,x) -» <f> n {a,x), 

The shit happening in G is happening isomorphically in T. (Go back to the example for Lie's first 
theorem and checkout the parallelism for yourself.) Then our almost separated example becomes 

^(a)^(a) \e{0c) ■ -g? - eior) ■ -gf j = {- + W)- 

Let's multiply the equation by the inverses of (a)^ (a), and the inverse of 0j<:Cf '). 

Since a and k are arbitrary elements of 7 we have a "classic" separation of variables situation. Both 
sides must equal a constant, namely the equation C$ A . We have separation of variables: 
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So back in the isomorphic differentiable manifold G, we now have nirvana. 



1. For a Lie group of transformations (in the geometric manifold G) with infinitesimal generators given by 



X x (x) = - 



dp* 



(5=0 



dx 



f/)e commutator relations are 



[X A (x),X 5 (x)] = 



. d d 
" Ua(x) 5x^'" u!c(x) ^ 



dx* 



= Q K a(uL(x)^ i ) = C| a X k (x). 



2. For o Lie group with generators (in T) 



x a(«) = ^r- 



ap* 



(5=0 



the commutation relations are obtained in an isomorphic way: 



[X A (a),X 6 (a)] = 



da 



„ 50* (a) „ 90? (a) 



da E 



da CT 



= C^(-0S(a)^) = C^ K (a). 



We have now shown that the structure constants are constant for a Lie group, a Lie group of 
transformations, and for any of their analytic realizations or matrix representations. Quod Erat 
Demonstrandum dudes. 



Example 7— The PDE from example 6 
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s)-G -f)(i')=( x 'r 2 ) 

a 2 / 



'dx' 
dx 



for x in terms of a are 



d dx d dx 

(x-q 2 ) = — 1 = 1 - 1 = 0, 



da 2 da 1 da 2 da 2 
d dx d 



T (D = 0. 



9a 1 da 2 da 1 

Therefore, we do not violate the integrability condition that all mixed derivatives be equal 

d 2 x a a 2 x' ; 



da^da v da v da^' 

so we can find a unique solution to these PDEs with unique initial value f(a = 0; x ) = x . 

The structure constants can be found from the group composition function <p. Since they are 
constant, they can be evaluated at any element. At the identity element Q(s) = ^(e) = n, with x = I 
so that Q{(x) = ®[(£) = n, (but dx' £ because it is a translation away from s) our old equation 



Collapses to 



K = dQ K s (l) dQlix) = d 2 0*(/?,q) d 2 0*(/?,q) 
SA da x da 5 d/3 s da k df3 x da 5 



P=a=0 



For our continuing example with 1 (/?, a) = /J 1 + a 1 , 2 (/?, a) = e^a 2 + f3 2 , we readily compute 



= a 2 2 (/?,a) d 2 2 (/?,q) 

12 a/? 1 ^ 2 a/? 2 aq! 
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Lie's third theorem. The structure constants obey 



r« — r K 
L 8X - L X8< 



Proof. From C aA = -^E-- -g^-l^, 



we have 



= a 2 K (/?,a) a 2 K (/?,a) 

5A 



/?=a=0 



The last equation is trivial, a trivial consequence of the Jacobi identity 

[[* a ,*/j]X y ] + [[*/?. *y]*«] + [[*y, = 0. 

The Jacobi identity follows from the associativity of the group multiplication. The Jacobi identity bears a 
strong resemblance to 

^if^M) = -^-six) + —^—. 

This is why the Lie bracket [ , ] is sometimes called a derivative. 

Example 8— Four of the eight structure constants for our elementary Lie group are necessarily zero by 
the antisymmetry requirement: 

Qi = ^11 = C22 = C%2 = 0- 
The only remaining four structure constants are independent and must be computed explicitly: 

C 12 = = 0, C^ 2 = ~ C21 = 1- 
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(Important to physicists). The structure constants for a Lie algebra provide a matrix 
representation for the algebra. Generally, this representation is unfaithful. The representation is 
obtained by associating with X^(fi = 1,2, ... , if) and rj x r\ matrix M^ii) x if) whose matrix elements are 

given by (M^ = -C^. 



Theorem. -> M^, (W^)^ = — C^ a is a representation for the Lie algebra of the commutators X^. 
Proof. Let's show that X and M have isomorphic commutator algebra. 

([ M ^ M v]f a = (Mj a tM v f y - (M v )1(mJ y = C; a C* - Cl a cl y . 
The Jacobi identity tells us 



C Y d +C y C P +C Y C P =0 



r Y r P _ rY rP — rY 
^•[ia ^vy L va 



( C ya)- 



Then [M M ,M V ]^ = C^ v (M y )^. Since matrix multiplication is well defined, these matrices trivially satisfy 
the Jacobi identity; they also form a basis for a linear vector space. Since X a and have is isomorphic 
commutation relations, the provide a representation of the X^. 

Example 9— From our above structure constants, we construct a 2 x 2 matrix representation for our 
two-dimensional Lie group: 

\ v w /0 1> 



Have we seen these before? Physicists this representation is sometimes called the adjoint or regular 
representation, and it is used extensively in the study of the properties of Lie algebras, in particular 
when we seek to classify the various types of Lie algebras. 
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Converses of Lie's three theorems. Lie's three theorems show that for each Lie group there is a 
corresponding Lie algebra. These three theorems characterize the Lie algebra by its structure constants. 
The Lie algebra is uniquely determined, up to a change of basis, by the Lie group. Now we ask, given a 
Lie algebra, can we find an associated Lie group? No. There is generally not a 1-1 correspondence 
between Lie groups and algebras. Many Lie groups may have the same Lie algebra (recall Part I ODEs 
and PDEs with the same Lie group symmetries (as analytic realizations), but among all of the groups with 
the same Lie algebra there is only one that is simply connected. This simply connected group is the 
universal covering group. I have yet to build up the little bit of algebraic topology required to deal with 
the converses of Lie's three theorems. The essence of the converses of Lie's three theorems is finding 
restricted cases for when one may uniquely associate a Lie algebra to a Lie group. The theorems are 
stated and proved in "An Introduction to the Lie Theory of One-Parameter Groups," Cohen, P. M., New 
York: Stechert, 1931. The converses of Lie's three theorems establish that there is a 1-1 correspondence 
between simply connected Lie groups and Lie algebras, but these converse theorems do not provide a 
method of constructing the analytic group multiplication = a) from the Lie algebra. Taylor's 

theorem goes to doing this construction in a canonical way. Physicists, Taylor's theorem lies at the 
heart of why we were able to find the time evolution of physical systems via iteration (exponentiation). 
It's extension underpins time ordering operators in path integral applications to quantum physics. 

Example 10— Let's motivate the theorem with an example first. It helps. We keep with the chain of 
examples we have been using since example 1. For our two-dimensional group, this is a straight line: 
ts a = T(a 1 , 0). (Recall: 0(t 1 t 2 , a 1 a 2 ) = (r 1 a 1 , z x a 2 + t 2 ), but we have a 2 = 0, so x{a 1 , 0) = 
(r 1 a 1 , t 2 ). (ts a is the name for the straight line; the RHS is the operational description of the line.) This 
is a straight line in the Lie group. Let 
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Then it follows that 



T(j = l)x = (l + a 1 x-^Jx = l + a x x~e aXx . 
Now let's repeat this for the straight line xs x = t(0, a 2 ). 



2 (_d_\ d 
T(t = 1) = e-" 2 ^ W = e " \ dx) » i + a 2 

ox 



Thus 



/ d \ 

T(t = V)x = \1 + a 2 —Jx = x + a 2 . 

Lastly, consider the straight line rs A = T(a l ,a 2 '). Then T(t) = e T v x sx a aJ . so 

T(r)x = e T ( alx ^ +a2 ^)x = f 1 + za 1 x^- + to 2 ^-) x = (1 + za r )x + to 2 = e za \ + % (e™ 1 - l). 

\ ox ox) a 1 v 7 

I hate shenanigans. The source author didn't show the intermediate steps. ^ (e Tal — l) « 

a 2 

— (1 + ra 1 — 1). (This has a smell of bogusness.) But now T(r) above compares well with r^a 1 , a 2 ) = 

|e A (Ta — (e _ l)\ Now let's see about Taylor's theorem for Lie groups. 
V 1 / 

Taylor's theorem for Lie groups. There exists an analytic mapping = ^{fi, a) in which 
every straight line through the origin is a one-dimensional abelian subgroup. The Lie group operation 
corresponding to the Lie algebra element is a^X^ -> e _aMx ^. 

Proof. Since X^x) = — u^(x) (see Lie's 2 nd theorem) we may write |^ = m%u l a (ja) as 



^ x =-^uUa)X a (x)x i 
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(Clever, since — u^(x) -^jx l leaves only — u^(x).) When we look at the straight line a^(x) = s^x 
through the origin of the Lie algebra, the x l are functions of the single parameter x: 

dx l (x) dx 1 da x , „ r 

-IT^ = ' T~ = - s X « = sx]X a {x)x\x). 
dx da A dx 

Note that s A = Since the coordinates of the fixed point [[x'(p)] are now reduced to being 
functions of a single parameter x, we can write 

x l (x) = x>(0)T/(t). 
Then our differential equation ^ reduces to 

J-r/(T)x;'(0) = -s^Z [a = sx]X a [x(x)]T}(x)xKO). 
Since the x'(0) are arbitrary, we have the following matrix equation 

^T/(t) = -s^[a = sx]X a [x(x)]T}(x) 

which is a first-order total differential equation for the matrix T(x) with initial conditions Tf(0) = Sj. 
Thus, 

^/WI T =o = s^[0]X a [x(0)]Ti(0) = s A X a [x(0)]8j. 

(I went back to Lie's first theorem to see that ^[0] = I because its inverse 0(0) is the identity.) The 
total differential equation has solution 

oo n 

7/0) = £ i [-ts a Z a [x(0)]<5/] = e- TsAx * M5 i = Sje- aXx ^ x \ 

n=0 
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The solution is unique and analytic if it converges. Also, since 



e -T lS X X Xe -T 2 S X X X _ e -(T 1 +T 2 )s X X X) 



every straight line through the origin of the algebra maps into a one-dimensional abelian subgroup. Now 
we can go back to example 10 to see this theorem's application with a fuller appreciation. 

Theorem (without proof) Every element of a compact Lie group G lies on a one-dimensional 
abelian subgroup of G and can be obtained by exponentiating some element of the Lie algebra. (Often 
theorems that hold for compact groups fail for noncompact groups {SU(N) are compact; the Poincare 
group is noncompact.) 

On time ordered operators (and Taylor's theorem for Lie groups). Using the figure below 

J t dt t j t dt 2 covers the entire area as of the square. J t dt x j t 1 dt 2 only covers lower half triangular 
area. (Think of the f's as time.) 



t 



t 








t 



t 



t 



So, 








Also, flipping the order on the LHS, 
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The mathematics is oblivious to the ordering of the integrals. To motivate T-ordered products, let me 
quote from the quantum mechanical formulation of path integrals. Path integrals in physics are set up 
with time proceeding from earlier times to later times. If t 2 > t x 



but if t x > t 2 , then {qftf\q(t 2 )q(t 1 )\q i t i ). This violation of time flow is handled in physics by the time 
ordering operator 



Let's get back to Taylor's theorem for Lie groups. The theorem involved integration in the Lie algebra 
along a straight line from the origin to some point a = (a 1 , a 2 , ... , a v ). It is not necessary to integrate 
along a straight line. A curve will also work. However, to make the theorem work, we will see that t- 
ordering of the group elements will be necessary. 

Let a^(r) be a curve in the algebra with the properties 



may be solved by iteration. (Along the straight line we had, notation-wise, = ra^. On the curve, 

notation-wise, we have some a^, the "straight line" slope of which is — ^— .) So, solving by iteration: 





a M( T = o) = (0,0 0), 



a f( T = 1) = (a 1 , a 2 a*). 



Then the differential equation 



— T}(t)xJ(0) = s^[a = 5t]ZJx(t)]T/(t)x>(0) 
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d da A (r) „ 



t(t)-t(o) = J o dT'| — ^^KOVtolno) 
+ J o ^^Ki")jf^Wr(o) 



Things simplify if we observe that T(0) = I. Also, relabel the integrand 



da A (j) 



V>Z[a{T)X a {x) = --M{T) 



dT "A L-v-,«av», ft 

(The mathematicians are sneaking in the physicist's Hamiltonian.) (Here is where r-ordering (or time 
ordering) comes in.) Note that the term coming from the second iteration can be rewritten 

4 T K)7 7 * di ' di "* (i ' wia 

where the symbol r symbolizes an ordering operator: 

J ^ ) be (t")H(t') if t" > t'" 
(The 2! Is counting upper/lower triangular areas.) If we define 
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{1, x > 
\, x = 0, 
0, x < 

then we can write 

tH(t')H(t") = + 9(t" - t')[H(t"),H(t')]. 

Clearly the r-ordered product is not equal to the usual product unless the commutator vanishes. Third 
and higher order iterations can be treated analogously. The iterative solution is then 

This result collapses to the straight line solution over a straight line (see Gilmore's Dover text.) I 
personally understand every section in the notes well except for this section. The physicist's version of 
all of this for path integrals is far more sensible to me— apologies. 

Topological concepts. Recall that a space is connected if any two points in the space can be 
joined by a line (in the sense of "line" we used to prove Taylor's theorem for Lie groups), and all points 
of the line lie in the space. 

Example 11— Still keeping with our running example, the topological space T 2 (I've been lazily writing T) 
is not connected because any line joining, say (1,0) and (-1,0) must contain a point (a 1 = 0, a 2 ) which is 
not in T 2 . If you go back to example 1, you'll recall we had x'(p) = — x(p). Thus T 2 = R 2 — 
(a 1 = 0, a 2 ). The y axis splits M 2 . 

If p is any point, we can look at the set of points connected to p, e.g., all points in the left half- 
plane are connected to (-1,0); all points in the right half-plane are connected to (1,0). A connected 
component of a continuous group (called a sheet) cannot itself be a group unless it contains the 
identity— duh. 
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Theorem— The component of a continuous group that is connected with the identity is a group. 

In addition, all other sheets of the continuous group are isomorphic as manifolds, both to each 
other and to the connected component. A new group structure can also be defined on each sheet, so 
that it becomes isomorphic with the connected component. 

A space is simply connected if a curve connecting any two points in the space can be 
continuously deformed into every other curve connecting the same two points. 

Example 12— The connected component of G(i,o) is simply connected since any curve (1,0) — q — p can 
be continuously deformed to any other curve (1,0) — q' — p' . (Recall the vertical axis is not in T 2 . 



P'm 






A, U 


(-1,0) 





You cannot get to the identity element from the left hand plane. The left hand plane is not simply 
connected. 

Algebraic concepts. This section assumes a background in abstract algebra up to the concepts 
of cosets and normal subgroups. Don't fret if you don't have this background. I build it up, step-by-step 
in the first few pages of Part V. Try reading the section first. I think you might already have sufficient 
background and context from our discussion of commutators to get this section. 

Let H be a subgroup of G (in our mind G being a continuous Lie group). Then for any element 
geG, the set of group operations gHg -1 = {ghig -1 ,hieH] also form a group, the group conjugate to 
H. (Think of gHg -1 in the sense of a commutator measuring how much the algebra may differ from 
being commutative; I never got this in junior, senior and graduate courses in abstract algebra.) 
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Example 13— The one-dimensional subgroup of G( 10 ) (the right hand half-plane of example 1) given by 
(a 1 > 0, a 2 = 0) gives rise to the series of conjugate groups 

(^.^XaSOO? 1 ,/? 2 )- 1 = (^a^-O + ^X/? 1 ,/? 2 )- 1 = (^a 1 ,/? 2 ) 

= (a 1 , -a 1 /? 2 + /? 2 ) = (a\/? 2 (l - a 1 ))- 

You can check the group axioms to confirm that the subset of group elements (a 1 , /? 2 (1 — a 1 )) 
generated by conjugation is indeed a subgroup of T 2 corresponding to G^ 10 y The subgroup conjugate to 
the abelian group (1, a 2 ) is 

(/? 1 ,/? 2 )(l,a 2 )(/? 1 ,/? 2 )- 1 = (l,/? 1 a 2 ). 

Every element in this conjugate subgroup is in the original subgroup. We signify this by writing 
gHg' 1 = H. Subgroups H that are self-conjugate for all elements of geG, are called invariant 
subgroups or normal subgroups. The subgroup H = (1, a 2 ) is an abelian invariant subgroup HAG. 

Theorem— The connected component G of a continuous group is an invariant subgroup of G; G AG. 
(Welcome to some algebraic topology.) 

Example 14— The right hand half-plane G^^AG. 

If H is a subgroup of G, (H < G), the structure G/H are called cosets. A right coset is the set of 
group operations Cq.c-^, ...,eG 3 (3 reads such that) 

Hc + Hc 1 + - = G, 

where no element geG is contained in more than once in the sum above as Hc t n Hcj = if i ^ j. The 
right (and left) cosets C R are disjoint. In another way of saying it, every element geG can be written 
uniquely (!) 
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g = hiCj, hi6H, Cj6C R . 
Analogously, left cosets C L involve a ! decomposition 

g = c k h h h x eH, c k eC L . 

Notation: A subgroup H of G is denoted by H < G. If H ± G, it is a proper subgroup denoted by H < G. 

Example 15— Let G = G (10) . H 1 = (a 1 > 0, a 2 = 0) < G. H 2 = (1, a 2 ) < G. (Geometrically, // x is the 
line (0, oo) lying on the a 1 axis; H 2 is a vertical line a 2 from — oo to oo situated at a 1 = 1.) 



{y\y 2 ) ^(k\o)o(x^. 



We can read this equation in two ways: (y 1 , y 2 ) e G = H x o C R since (y 1 , 0)eH and ^1, ^) e C R , or 

(y 1 ,/ 2 ) e G = C L o H 2 since (y 1 , 0) e C L and (l<^i) e H 2 . Draw pictures to better see this! It also 
never hurts to check things. Let's check gh 2 g _1 . 

(y 1 ,y 2 )(l,a 2 )(y 1 ,y 2 )- 1 = (y\ Y 2 Kl,a 2 )(^,- Y ^j = (y\y 2 ) {^~^+ « 2 ) 
= (1, -y 2 + y x a 2 + y 2 ) = (1, y x a 2 ) e H 2 . 

Theorem— Left and right cosets G/H of a continuous group G by a closed subgroup of H are manifolds 
of dimension dim G — dim//. (Wow). 

I offer no proof here, but I do provide an example. We have 

dimG = dimG( 10 ) = 2 — dimH-^ = 1, 

dimG = dimG( 10 ) = 2 — dim// 2 = 1. 
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Theorem— If H is an invariant (normal) subgroup of G then the coset elements c , c lt can be chosen 
in such a way that they are closed under multiplication and form a group called the factor group G/H. 

Note that H x is not an invariant subgroup of G, yet G/H-^ is a group. Accidents like this can happen. On 
the other hand H 2 AG and the theorem above guarantees that G. H 2 is a group, a factor group. 

Example 16— The connected component of G (G(i )) is an invariant (normal) subgroup. Every element 
of G can be written, for example, as either 

r(^.o) or fl o(-lo) 

3fG(i,o> c ° = (i')' Cl = ( - ^' )' 

The coset representatives c , c x consist of one element from each sheet. This is not the most clever 
choice (an art) for coset representations. A better choice would be c = (1,0) and C x = (—1,0). This 
forms a closed group ((Z 2 , +» since (1,0) 2 = (1,0), (-1.0) 2 = (1,0), (1,0)(-1,0) = (-1,0) = 
(— 1,0)(1,0). Generally, a good choice for coset representatives for the factor group 

^continous 
^connected component 

would be the element in each sheet that becomes the identity under the mapping that turns that sheet 
into a group isomorphic (=) with the connected component. Let's illustrate this. A many sheeted 
continuous group G can be written as the sum of group operations of the form 

diG = e?;G , 

i=0 

where the d t e D and G is the connected component. Each sheet is topological^ equivalent as a 
manifold. Only G = d G can be made isomorphic with the subgroup G by acting with d" 1 on the left. 
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Theorem— The factor group of a continuous group by its connected component G is a discrete group 
Dof dimension 0. That is G/G = D and dimD = 0. 

With this theorem we can study all continuous groups if we study separately (A) only the connected 
continuous groups and (B) discrete groups. 

Referring to the figure above, if we know the structure of the connected component G of a 
topological (continuous) group, the structure of the discrete group D = G/G , and the structure of the 
mapping DG D _1 -> G , the structure of the entire continuous groups G can be constructed as follows. 
Let 

g = eG\d i a d it dj e D c G. 
i 

h = e G ' di/3 a,p e G c G. 

Then 

g °h = d t a ° adj/3 = didjidj 1 ad^)fi = (d k = djd ; )(a' = d ; _1 ad! ; )/?. 
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Since D has a group structure, the product d t ° dj = d k e D. Since G is an invariant (normal) subgroup , 
d~ x adj e G . Therefore, the group multiplication properties in the discrete factor group D and in the 
connected continuous component G , together with the mapping a -> a' = d~ x adj uniquely determine 
the group multiplication properties of the entire group G. 

Let the elements of the discrete group D be d = identity, d 1( d 2 , ... , d n , ... and let G t be the 
sheet containing d t . Then the sheet containing the identity d e D is the connected component G . The 
mapping that converts any sheet G t (which cannot be a group unless i = 0) into a group isomorphic with 
G is given by 

G t = diG ^d^diGo = Go- 
See the figure above for this process. 

The invariant integral. The study of functions defined on the group manifold G require the use 
of an integral function defined over the group elements. The rearrangement property . The operation of 
multiplication by a group element may be interpreted either as a mapping of the entire topological 
group onto itself, or as a change of basis within the topological space. If /(/?) is any scalar-valued 
function defined on the group (or equivalently on the topological space T) then a reasonable 
requirement for a group integral is 

jf(fi)dn(fi) = ff(ap)dn(fi) = j f(a(3)dn(af3). 

This is reasonable because if the sum over /? involves each /? exactly once, the sum over a/3 involves 
each group operation also exactly once (in a scrambled order). Since / is an arbitrary function, we 
demand of the measure defined on the group that it obey 

dn L {fi) = d l i L {aop). 
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Measures with this property are called left invariant measures. Right invariant measures can also be 
defined: dfi R (/i) = d[i R ((J ° a). 

Reparameterization of G n . We first define group integration on the connected component of a 
continuous group; then we extend it to the entire continuous group. We shall also demonstrate these 
concepts on the connected component of our old example group. 

Since it's common to associate the origin of R v with the group identity s, reparameterization of 
the connected component G may proceed as follows: 



Now let 8a 1 , 8a 2 denote infinitesimal displacements in the topological space R 2 . The volume 
at the identity enclosed by 8a 1 A 8a 2 is shaded in the figure below (left invariant measure). 




Under this reparameterization, 



0? 1 ,/? 2 ) o (a 1 , a 2 ) = + a 2 ,e^a 2 +/3 2 ), 



(a 1 , a 2 )' 1 = (-a\-e- al a 2 ). 



Y 



o 



d-a 2 — ea 






o 
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Let's fill in the details for the left invariant measure. 

(a 1 , a 2 ) o (0,0) = (a 1 + 0, e" 1 ■ + a 2 ) = (a 1 , a 2 ). 
(a 1 , a 2 ) o (5a 1 , 0) = (a 1 + 5a 1 , e 3 " 1 • + a 2 ) = (a 1 + 5a 1 , a 2 ) 

Since a 1 -> a 1 + 5a 1 , then da 1 = 5a 1 . There is no change of scale alone the a 1 axis. On the other 
hand, 

(a 1 , a 2 ) o (0, 5a 2 ) = (a 1 , e al 5a 2 + a 2 ), 

So da 2 = e al Sa 2 . The transformed rectangle is stretched along the a 2 axis. Then the volume element 

SV L (s) = da x da 2 = e^SaHa 2 . 

What about the right invariant measure? 

(0,0) o (a 1 , a 2 ) = (0 + a 1 , e°a 2 + 0) = (a 1 , a 2 ). 
(5a 1 , 0) o (a 1 , a 2 ) = (a 1 + 5a 1 , e 5a V + 0) = (a 1 + 5a 1 , e 5a V). 
So again a 1 -> a 1 + 5a 1 , and da 1 = 5a 1 . Now, 

(0, 5a 2 ) o (a 1 , a 2 ) = (0 + a 1 , e°a 2 + 5a 2 ) = (a 1 , a 2 + 5a 2 ). 

So a 2 -> a 2 + 5a 2 . This seems right, but it is not what the source author concluded. (Shenanigans are 
afoot.) Here is what probably makes the most sense for extracting these deltas the right way. Do it all in 
one shot. (Doing it in pieces might get you lucky— the right results.) 

(5a 1 , 5a 2 ) ° (a 1 , a 2 ) = (a 1 + 5a 1 , e Sa " a 2 + 5a 2 ). 

We get a 1 -» a 1 + 5a 1 . Expand the exponential to first order, and a 2 -» a^a^a 1 + 5a 2 . So 
da 2 = a 2 5a x + 5a 2 . Fixing crap like this over spans of years and books is wasted time. 
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Let /? be any point infinitesimally near to the identity and within the volume element SVas we 
have shown in the figure for left invariant measure (and our imaginary picture for right invariant 
measure). Under translation by a ° (a ° /?) the volume element 8V(s) around s expands as it is moved 
to a volume element 8V L (s) around a. The coordinates of any point a ° (8a 1 ° 8a 2 ) may be expanded 



as 



d(p^(a,/3) 

(a + day = 0(a, 8a) = 0"(a, 0) + a A 



8a x + 





The Euclidean volume element 8V(e) expands as it is moved around by the factor 

a o 8V(e) = 8V L (a) = da 1 A da 2 = (8a 1 ) A (e ftl 8a 2 )8V(e). 

(For the reader who has notice the operator A, I'm pretty sure the source author is thinking in terms of 
differential forms. We're okay thinking of it as a simple product in this work). Therefore we should 
weigh the Euclidean volume element in the vicinity of a by a factor e~ a to preserve volume invariance 
over the entire topological space: 

Invariant volume element = density x Euclidean volument elelment. 

For the right translation by a, we have, analogously, 

8V(s) o a = 8V R (a) = da 1 A da 2 = (8a 1 ) A (a 2 8a 1 + 8a 2 ) = 8a 1 A 8a 2 = 8V(s). 

We dropped 8a 1 A a 2 8a 1 because this is a 2 nd order term. Evidently then, the right invariant integral is 
defined by a uniform density, whereas the left invariant density is nonuniform, defined by e~ a . 

General right and left invariant densities. We now turn to the general case. Let 
8a 1 , 8a 2 , ...,8 aV be infinitesimal displacement n the ?y independent directions of R v at the identity 
element 0. The volume they enclose is give by 
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SV(0) = p^Sa 1 A 8a 2 ... Sa^. 

Move this volume element to an arbitrary element dV(0) to an arbitrary group element a by 
left translation, and demand of the density function that 

p(P)dV(0) = p L (a)dV L . 

Here dV L (a) is the Euclidean volume element dV(0) after it has been moved from the vicinity of (0) to 
the vicinity of (a) by left translation with a. It is easy to compute dV L : 



dV L {a) = da 1 A da 2 A ... A da^, 



(a + daY = <^(a,\Sa) = 0"(a, 0) + 'a 



df3< 



/?=o. 



Then we have 



a0 1 (a,/?) 
dV, (a) = ri — 



, d<f> 2 {a,p) 
Sa A A 



dp 



A 2 



Sa 22 A ...A= det 



/?=o 



<?0" (a,/?) 



dK(0). 



/?=o 



The density for left translations must thus satisfy (p(0) = 1) 



PlO) = 



device, p) 



-i 



/?=0 



Doing all of the above for the right leads to 



A? OO = 



50"(/?,a) 



-l 



/?=o 



These invariant densities are Haar measures. 
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Equality of left and right measures. The left and right measures computed in our previous 
figure were not equal. Furthermore, the integrals 



for our example do not converge (though any integral J f(a)p LR (a) dV{a) 

which did converge would be invariant. Where are the left and right measures equal? And we do they 
converge? 

Theorem— The density functions p L (a) and p R {a) giving the left and right invariant measures of 
compact group are equal. 

Proof. Begin with an element of volume dV(0) at the identity of the group operation. Move this 
element to an invariant volume at a by left translation. The result is 



If we now move this invariant volume back to the identity using right translation by a -1 , the result is a 
volume element at the identity, but with a possibly different size and shape. The left translation 
mapped a rectangle to a rectangle with the same orientation, but the right translation, had I drawn it, 
results in mapping a rectangle to a rotated parallelogram. Mathematically we have: 




dix L {a) = p L (a)dV L (a). 



[p L {a)dV L {a) o a 1 = p L (a)dfj.(0)p R (a 



d^CO) =fia)dfi(0). 



Then define recursively 
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d/^ +1 (0) = a o d^(0) o a' 1 = (a)" +1 o dfi(0) ° (a" 1 )"* 1 

d/i" +1 (0) = f{a)d^{Q) = /" +1 (a)d/i(0). 

Since the group is compact (and every sequence has a convergent subsequence) the limit as n -> oo 
exists and is well defined: lim Tl _ >00 (a) Tl = /?, and 

dn°°(0) = lim a^d/i(0)(-a) n = lim [/(a)] n d/i(0) = f(p)dfi(0). 

n->oo ' n->oo 

If /(a) 1, then lim [/(a)] n is infinity for the > case and for the < case. But since /? is an element of 

n->oo 

the group, /(/?) can be neither nor infinity, for then the operation /? ° d/i(0) ° would be singular. 
We are forced to conclude that /(/?) = 1, thus p L (a) = p R (a) and dpi L (a) = dpi R (a). The left and 
right measures on a compact group are equal. 

Note from source author: The left and right measures equal on the following kinds of groups: 

1. Finite groups. 

2. Discrete groups. 

3. (Locally compact) abelian groups. 

4. Compact groups. 

5. Simple groups. 

6. Semisimple groups. 

7. Real connected algebraic groups with determinant +1. 

8. Connected nilpotent Lie groups. 

9. Semidirect product groups such as SO(3) A T 3 or 7SO(3); Poincare groups S0(3) A T 31 , or 
ISO(3,l). 

10. Constructions of semisimple groups by maximal subgroups: ISO(p,q), IU(p,q), IUSp(2p,2q). 

11. Lie groups for which Ad(G) is unimodular. 
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Extension to continuous groups. The invariant integrals have so far been built for the connected 
components of a continuous group. To extend to the other sheets we need to observe two things. 
1. Every element a e G can be written as a = d t ° a where d t e D, a discrete factor group, and 
a e G , the connected component. 2. Each sheet is topological^ equivalent to every other sheet. 
The required extension is then 



If it happens that the connected component is of dimension zero, it contains only one point, the identity 
and the invariant integral reduces to (with p(s) = 1) to the form familiar for discrete groups: 



Part III were my notes from Gilmore's text, specifically from chapters 3 and 4, interspersed with 
filled in steps and underlying physical motivations. The first two chapters are worth a read, especially 
the stuff dealing with metrics. Three more blocks of ideas remain regarding symmetry methods. 
Chapters 1-4 of Jones' text develop the mathematics of discrete groups (our focus has been primarily on 
continuous groups, but not exclusively). We learn how to create characteristic tables for discrete 
groups. You connect these practical results with the first chapter of Gilmore's 2008 text and you have a 
proof of Galois' work on the insolvability of the quintic by radicals. I never got it from crappy formal 
training overloaded with blinding abstraction. These cover the first two of the remaining blocks. 




f{a)p{a)dV{a) = ^ I f(d t ° a )p(a )dV(a ) 
<£?D Ja o eG o 




d t eG 



Done on this. 
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Is the quintic really unsolvable? Yes. By radical extensions. Galois showed us this. But 
mathematicians have built a mathematical technology, if you will, to get around the limitations of 
solvability by radicals. They have built on the theory of elliptic functions and elliptic integrals to deal 
with questions of solvability. I only know one elliptic integral well. It arises from the study of the 
pendulum for larger angles, where one can't use the Taylor approximation sin 6^6. Find impossibility. 
Find workaround. Be water my friend. Can't trisect an angle, double the cube, square the circle? Get 
the hell out of here! Go pick up something more than a straightedge and compass. C'mon. There are 
pathologies with vector (or gauge) potentials. Workaround. Connections over principle bundles. The 
best step-by-step book treating connections on bundles is "Geometry, Topology and Physics," M. 
Nakahara, Institute of Physics Publishing, 1990. The relevant material is in chapters 9 and 10, which I 
found I could jump into without reading prior chapters. The early chapters, however, are worth a read, 
especially on homology and homotopy. I understand there is a second edition. The book, "Topology, 
Geometry and Gauge Fields," by G. L. Naber, Springer 1997, 1 found impenetrable. Yet Naber does do a 
good job of connecting the mathematics to the physics at the word level, feeding my understanding. 
This material is drier— apologies. 

Assuming that you have a junior level background in quantum mechanical addition of angular 
momentum, the final block on algebra is COMPLETELY SELF CONTAINED In FULL DETAIL. You will study 
Addition of Angular Momentum in terms of tensor products and direct products matrix methods, ladder 
operators and Young's tableaux. We will cover SU(2) for electron spin and Isospin and SU(3) for the 
quarks u, d and s. As a useful aside yielding selection rules, we will present in FULL DETAIL the 
application of the Wigner-Eckart theorem applied to scalars and vectors, and then extend the results to 
tensors. You may skip this if you're more interested in particle physics such as the Standard Model and 
its extensions to Grand Unified Theories (GUTs) and Theories of Everything (TOEs). What you will learn 
for SU(2) and SU(3) will be generalized in terms of the Cartan subalgebra with attendant ladder 
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operators, root and weight diagrams and Dynkin diagrams so that the 2 n half of Jones is becomes much 
more readable, and so that you might have some chance of working through trash like Georgi's book on 
Lie algebras and particle physics. 

Part IV . (The first six pages quickly review sophomore algebra.) We've just finished seeing the 
algebraic topology of continuous groups in terms of cosets and invariant (or normal) subgroups. Here 
are their discrete versions. Consider the symmetries of an equilateral triangle on the plane. 




We may rotate by 0°, the identity operation e. We may rotate to the left by c = 120°. We may rotate 
left by c 2 = 240°. We may reflect the left diagonal b. We may reflect about the right diagonal b 2 . We 
may reflect about the vertical diagonal b 3 . These operations lead to finite, discrete group D 3 with table: 



* 


e 


c 


c 2 


b 


b 2 


b 3 


e 


e 


c 


c 2 


b 


b 2 


b 3 


c 


c 


c 2 


e 




b 


b 2 


c 2 


c 2 


e 


c 


b 2 


b 3 


b 


b 


b 


b 2 


h 


e 


c 


c 2 


h 


h 




b 


c 2 


e 


c 


b 3 


b 3 


b 


b 2 


c 


c 2 


e 
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The element e is a (proper) subgroup of D 3 , as are the elements C 3 = {e, c, c 2 }. There are no other 
proper subgroups. We write e < C 3 < D 3 , where D 3 is the dihedral group of the triangle, C 3 is the 
cyclic group of the triangle, and e is the trivial subgroup. (A cyclic group is any group generated by a 
single element; for the triangle we could pick c to be the generator as c • c = c 2 , c 2 ■ c = e, e • c = c.) 
The subgroup C 3 has the following one-dimensional representation 



These are 1 x 1 dimensional unitary matrices. Each of these matrices is irreducible (so, peeking ahead, 
C 3 = D(e)0f (c)0D(c 2 ); note that l 2 + l 2 + l 2 = 3; this will have meaning). 

Conjugacy. a,be G are conjugate if there exists (3) g e G 3a = gbg~ 1 . We call g the 
conjugating element (fun) and we write a~b. (Back in continuous groups this is the commutator, a 
measuring device indicating how much the group deviates from being commutative (abelian).) 

Conjugacy classes, [a] = {b\b~a). This reads, the conjugacy class of a is the set of all b that 
are equivalent to a. (It's tacit that a,b e G. The tilde denotes equivalence relation. 

For C 3 each element is a conjugacy class, as is the case for all abelian groups; V a e G, a = 
agg' 1 = gag' 1 for some g e G. For D 3 we have three conjugacy classes: [e], [c,c 2 ], [b, b 2 ,b 3 ]. 
Certainly e = geg' 1 V g e G. Check all the cases, i.e., b = b^b^ 1 = b 3 b 2 b 3 = b 3 c = b 2 , and so on. 

In terms of 2 x 2 matrices, the group D 3 elements are represented by 



2ni 



4ni 



D{e) = 1, 



D(c) = e 3 , 



D(c 2 ) = e 3 . 
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The subgroup C 3 is represented by the first three of these six matrices. The dimension of a 
representation is the dimension of the space on which it acts . We have seen both a one-dimensional 
representation of C 3 and a two-dimensional representation. When we define the regular 
representation, we will see that it is three-dimensional for C 3 , with a concomitant geometric picture, 
and that for D 3 the regular representation is six-dimensional. The dimensionality of the regular 
representation will be the size of the group. ( Note : This is sophomore/junior level modern algebra. The 
pace will be fast through these basics.) 

Left (right) cosets. Given a subgroup H < G the left cosets are {gH} (or {Hg} for right cosets). 

Lagrange's Theorem— If H is a subset of G [H < G), then [#]|[G] (read the order of H divides 
the order of G. (The proof is sophomore modern algebra.) 

Example 1— [C 3 ]|{D 3 ] = 3 1 6 = 2. Three divides six equaling two. Another notation is D 3 /C 3 = 2. 

Normal subgroup. If H < G, we say H is a normal (invariant) subgroup of G [HAG) if 
V g e G, gHg- 1 = H. 

Example 2— C 3 A D 3 . Let's check. I'll be abusive with notation to cut the work down. Pick any element 
from each of the three sets and will get {b, b 2 , b 3 } ■ {e, c, c 2 } ■ {b, b 2 , b^' 1 = {e, c, c 2 } = C 3 . This is also 
true for {e, c, c 2 }{e, c, c 2 }{e, c, c 2 } -1 = {e, c, c 2 } = C 3 . 

There are two additional groups you should be aware of, the permutation group S n and the 
alternating group A n . Depending on the author, you will find the multiplication rule of these groups 
reversed— it's confusing. Here is an element of the permutation group S 3 on three symbols: 



The symbols 2 and 3 have been exchanged. An example multiplication of two members of S 3 is 



2 
3 
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a 2 3V 1 2 3) = ( 1 2 3 ) = (12) 
VI 3 2/V3 1 2/ V2 1 3/ v 

The (1 2) notation is called cycle notation. I started on the right parenthesis, noting that 3 goes to 2, 
then in the left parenthesis, 2 goes to 3; so 3 remains unaffected. Then we go back to the right 
parenthesis to see that 2 goes to 1, then over to the left parenthesis to see that 1 goes to 1. So, 
effectively 2 goes to 1. Then lastly, from the right parenthesis I see that 1 goes to 3, over to the left 
parenthesis to see that 2 goes to 2. Thus 1 goes to 2. The shorthand cycle notation captures this group 
multiplication succinctly with (1 2); 1 goes to 2; 2 goes to 1; 3 remains unchanged. Given three symbols 
{1,2,3}, we know there are 3!=6 permutations, thus S 3 is a group of order 3. The alternating group on n 

n 1 

symbols, A n is the group of even permutations of S n . A n has — elements. Example of an odd 
permutation 

(3 4 5 2 l) = (1 5X1 3X2 4) " 

We cannot express the group element on the left by an even number of 2-cycles, e.g., (1 5). Had the 
group element been expressible by an even number of 2-cylces it would have been an even 
permutation, and a member of A 5 . We trouble about these because of the following theorem. 

Cayley's Theorem— Every finite group is isomorphic to a subgroup of S n . That is 

There is a sophomore level proof I'll level to an introductory book. 

Quotient group (Factor group). Let me first give you an example using D 3 . Let E = C 3 = 

{e, c, c 2 } and let B = {b, b 2 , b 3 }. Observe that E and B form a group: 
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Li 


ft 

D 


E 


E 


B 


B 


B 


E 



The group is labeled D 3 /C 3 , which is a quotient or factor group. This example jives with Lagrange's 
theorem for |D 3 /C 3 | = 2, the order of this quotient group is 2 = 6/3. D 3 /C 3 is a mini version of D 3 if you 
will thanks to equivalence relationships. 

Homomorphism. A homomorphism is a mapping / from one set A to another set B preserving 
some structure in A. 

Example 3— We may map the integers to the even integers by n -> 2n. The integers under addition 
form a group for they are closed under addition, have additive inverses, is the identity, adding is 
associative. All this applies to the even integers. Our mapping is a homomorphism persevering the 
group structure of the integers under addition to the even integers. 

Isomorphism. A homomorphism that is 1-1 and onto is an isomorphism. In sophomore level 
mathematics you learn that you may map the integers to the rational numbers, but sets are countable. 
There is a 1-1 homomorphism linking the two sets— an isomorphism. Some people say injection instead 
of 1-1, and surjection for onto, and bijection for 1-1 and onto. I guess it sounds sexy. 

Image. Given a mapping between two sets A and B by/, the image of / is Im/ = {b e B\b = 
/(a) for some a e A}. Images may be 1-1, onto, or 1-1 and onto. Preimages are inverse images. 

Kernel. The kernel Kerf = {a e A | /(a) = e B e B], where e B is the identity element of B. 

Isomorphism theorem. If /: G -> G is a homomorphism of G into G' with kernel K, then the 
image of / is isomorphic to the G/K. Im(/) = G/K. 
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Think about this, if the kernel K = e, the identity element, the order of {e} is one, and by 
Lagrange's theorem, |G|/|e| = \G\. So the mapping / is 1-1. G and G' are the same size and have the 
same algebra. They are different only in as much their symbology is different, e.g., matrix 
representations versus analytic realizations. 

Up to this point, we have the minimum algebra we need to proceed. If these definitions and 
theorems become fuzzy, review the triangle group D 3 , or whip out the square and work out its group 
structure, then check the theorems with concrete examples. We begin the Jones notes. Think of group 
representations in terms of matrix representations. 

A representation of dimension n of a group G is defined by D: G lxomo 'G£{n, €) where D are an 

n x n nonsingular complex matrices. IMPORTANT. Two [n] representations of a group G are 

equivalent (~) if D^\g) = 5D®(flf)5 -1 V g eG, S independent of g. This is a similarity 
transformation 



SD^igg^S- 1 = SD^D^ig^S' 1 = SD ( - 2 \g)S- 1 SD ( - 2 \g')S~ 1 = (SD^S^SD^ig^S- 1 ) 
= DW(g)DW(g') = DW(gg'). 



Example 4— In quantum mechanics one often seeks to diagonalize a matrix (change its basis to a 
diagonal basis) by similarity transformation. Consider 



The trace of the matrix is 2. The determinant is 0. This gives us two constraints on the eigenvalues. 



D®Cgg') = DW( S )D®Cg'). 



Thus 
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A 1 + A 2 +A 3 = 2, AiA 2 A 3 = 0. 

Here is something that fits the constraints: A x = 2, A 2 = 0, A 3 = 0. We could have proceeded with 
more traditional matrix algebra: 



det 



1-A 1 

-A 

1 1-A 



= (1 - A)(-A(l - A) - 0) + A = 0. 



The resulting polynomial is A 3 — 2A 2 = A 2 (A — 2) = 0. The roots are {2,0,0}. For each root, we then 
find the eigenvalues as follows. Pick eigenvalue 2. 

(1 lWzH /x 1 ^ 
x 2 = 2 x 2 . 

Vl l/\x 3 / Vx 3 / 

Working this out means 



^x 1 + x 3n 



Vr 1 + x 3 / 



This can only be so if x 2 = and x 1 = x 3 . Keeping it simple, let x 1 = x / = 1. Then indeed 



A — v 3 



1 _ v 2 _ 



(; 5 !)© =2 6) 

The eigenvector is an eigenstates of the physical system. In quantum mechanics eigenstates are 
normalized to 1 because of its probabilistic interpretation. The dot product (or length) of the 
eigenstates is 



(1 1) yoj = 2. 



So let the normalized eigenvector be 
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Mi, 



Now the normalized length is 1. The remaining eigenvectors are 

1 / 1 \ /0\ 



— and 1 



The dot product of any two distinct normalized eigenvectors is 0. They are mutually orthogonal. From 
these eigenvectors, construct the matrix 



U 



l T2 ^ 

10 

1 -1 

\H Ti) 



Then note that 



/2 0\ 
H' = lo = U f HU, 
VO 0/ 



where the dagger indicates complex conjugate transpose. Our matrices happen to be real-valued. The 
new eigenvectors are 



•)■ 



which are the new basis vectors for the new coordinate system in which H has been transformed to the 
"diagonal" basis. H is equivalent to H' and conversely. The two are connected by a similarity 
transformation. The probabilistic underpinning of quantum mechanics forces the H to be hermitian 
matrices and the U to be unitary matrices. 
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The character of a representation D of a group G is x = ix (#) I £7 e G}, where j (g) is the trace 
of the matrix representing the element g (the sum of the diagonal elements). Simple theorems tell us 
that Tr(ABC) = TrG4CB) = ••• and the remaining four permutations of the symbols. Also, 
Tr(SD(g)S- 1 ) = Tr^S^D^)) = Tr(D( 5 )). 

Example (5)— The theorems ahead are dry enough and abstract enough that I lead the theory with an 
example of what they will empower us to do, namely to break a group down into its irreducible 
representations. You might have to iterate more than once between this example and the next 
example, as well as the theorems to get the idea; at least this was the case for me over an extended 
period of studies interspersed with breaks. Enjoy the next two pages written for now without 
justification. 

Recall C 3 : 



One theorem will tell us the number of irred 



ucib 



le representations equals the number of conjugacy 
classes. This is three for C 3 . One of these conjugacy classes, as always, is the identity e. Is c conjugate 
to c 2 ? Yes if there is an element g £ C 3 3 c = gc 2 g _1 . Well c c 2 c 2 c~ 2 = c 2 c 2 c = c 2 e = c 2 , but 
c = e 2 ce~ 2 = c. So c~c, a conjugacy class of size 1; ditto for c 2 . Another theorem ahead will state that 
the sum of the squares of the dimensionalities of the irreducible representations must sum to the order 
(size) of the group: n 2 + n| + n 2 = 3, implying C 3 is the direct sum of three one-dimensional 
representations (only l 2 + l 2 + l 2 = 3). This is stupidly obvious for C 3 , but as you'll see for D 3 we 
have l 2 + l 2 + 2 2 = 6, two one-dimensional representations and one two-dimensional representation. 
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The characters of a one-dimensional representation must mimic the group multiplication. In 
particular j(c 2 ) = (j(c)) and j(c) 3 = j(c 3 ) = j(e) = 1; this can be so if j (c) is a root of unity: 1, 



a) = e 3 , or or = e * . So the character table begins to look like 



c 3 


e 


c 


C 2 


D (l) 


1 


1 


1 


D (2) 


1 


(a) 


O) 2 


D (3) 


1 


<d 2 


0) 



If i = 1<2.3 are the three rows above (three row vectors), another result will be that the 
divided by the order of the group are orthogonal. Let's check some case using the scalar product: 



(x il) ,x w ) = -d + i + D = i, 



{x m^2) ) = _ cl + (O + a) 2 ) = 0i 



by virtue of the factorization of a) 3 — 1 = (<y — 1)(1 + u> + a) 2 ). Consider the (non-regular 
representation) 3x3 rotation matrices about the z-axis as a representation of C 3 : 



(\ 0\ 
e = 1 , 

\o o i/ 



c = 



2 
V3 



\ 



2 
1 

"2 °, 
V 



I- 1 - H n\ 



,2 _ 



6=2n/3 



\ 





Z 2 
V3 1 
2 2/ 

01/ 



0=47T/3 



Let's define the compound character x- For C 3 (with matrices above) x = (Tr(e) = 3, Tr(c) = 

0, Tr(c 2 ) = 0); is this so for other representations? If so, when? We'll see. In x we've constructed a 

three dimensional object with three orthogonal unit vector components of "simple" traces: 



X = {X{e),x{c),xic 2 )) = (3,0,0) = a lX m + a 2 ^ 2) + a 3 x {3 \ 
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1 1 

where a v =< x,X v >> v = 1,2,3. For example, a x = - < x> X 1 >= 3 3 = 1. This is very quantum 



mechanical formalism in the sense of Dirac's formalism of quantum mechanics. 

The group C 3 = © © D^, a direct sum of three inequivalent one-dimensional 
irreducible representations with geometric interpretation: represents rotations about the z axis 
leading to x' = x cos 9 — y sin 9 and y ' = y cos + x sin 0. Now consider the sums 



For the angle 9 = ■: e w = a). Thus x + iy is the geometric basis of D^. With 9 = ^,we have 

e 10 = <y 2 . The representative of is x — iy. These two are one-dimensional lines on the complex 
plane— the diagonals of our equilateral triangle. The one-dimensional z-axis pokes out perpendicularly 
to the lines x ± iy. The diagonalized "Fourier" decomposition of the group C 3 is 



Each representation acts on M 3 triples (x,y, z) as we have described. For C 3 each representation is a 
one-dimensional unitary matrix— a complex number. For the quantum physicist we now know the 
group C 3 acts on three orthogonal kets, |2) and |3>. 

A glaring question at this point might be why I didn't use the two-dimensional matrix 
representation to compute x instead of the three-dimensional rotation matrices? Could I have used 
4 x 4 (or larger) square matrix representations? The theorems and constructions themselves lead to 
matrices of the proper size for our traces. When you are plowing thru the theorems, recall this example 
as the particular case being generalized. Character tables underlie the insolvability of the quintic. A 



x' ± y' = x(cos 9 ± i sin 9) ± iy(cos 9 ± i sin 9) = (x + iy) e 
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word of advice before digging in. Plug in examples from the C 3 and D 3 groups using their various 
representations every chance you get. Here is the regular representation for C 3 : 



/0 1\ no 0\ /0 1 ON 

D(c) = 1 , 0(e) = 1 , D(c 2 ) = 1 

\o 10/ Vo o i/ Vi o o/ 



Here's how to make these matrices using C 3 's group table and orthogonal bra-kets. Starting with C 3 let 

/(9i\9i\9i) (9i\9i\92) (9i\9i\93)\ / (e\e\e) (e\e\c) {e\e\c 2 ) 
D{g 1 = e) = Ug 2 \g 1 \g 1 ) {g 2 \gi\g 2 ) (#2M#3> = I <c|e|e> (c\e\c) (c\e\c z ) 

\{g 3 \gi\gi) (g^gM (gMgs)/ \(c 2 \e\e) (c 2 \e\c) {c 2 \e\c 2 ). 











)-G 


1 


:) 










(c 2 \e) (c 2 \c) (c 2 \c 2 ) 



where in our notation two group elements g b gj are parallel if i = j (that is (gi\gj) = 1 if i = j) 
otherwise \fi=tj the group elements are orthogonal (that is (g t \gj) = if i j). Proceeding to c we 
get the following 3x3 matrix: 



'<0il02l0i> (gi\g2\g 2 ) <0il0 2 l03>\ f <e\c\e) <e|c|c> (e|c|c 2 > 

0(52 = c) = ( (g 2 \g 2 \gi) (g 2 \g 2 \g 2 ) (g 2 \g 2 \g 3 ) = <c|c|e) <c|c|c> (ckk 2 > 

,<5 3 l5 2 l5i> (g 3 \g 2 \g 2 ) {g^gMJ \{c 2 \c\e) {c 2 \c\c) (c 2 \c\c 2 ) y 

(e\c) (e\c 2 ) (e|e) 

;|c) ( C |c 2 > (c|e> 

,(c 2 |c> <c 2 | C 2 > (c 2 | e > 



The 3x3 matrix D(g 3 = c 2 ) follows from this notation. This is how we build the regular 
representation for finite groups. 

Reducibility. A representation of dimension m + n is reducible if D(g) takes the form 










Hi 





l ) 




1 


0/ 
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A, B, C, being matrices of, respectively, dimension mxm, mxn, nxn. The matrices are closed: 



Ma) C(g)\(A'(g) C'(g)\ = (. 
. B(g))\ B\g)) \ 



A{g)A\g) AC' + CB' 
. B(g)B'(g) 



H 



Mgg') C(gg') 
■ B(gg') 



where C(gg') = AC + CB' . This is certainly true of the 3x3 rotation matrix around the z-axis if you 
think of it in the form 



The representation is completely reducible if C(g) = 0. Then D(g) is the direct sum D(g) = A(g) © 
B(g). If A and B are reducible, we proceed until we reach an irreducible representation. 

A set of vectors {ej, i = 1,2, ... , m is linearly independent if there is a non-trivial combination 
which yields the null vector YSLih e i = ^> A; = Vi. A linearly independent set of vectors 
{ej, i = 1,2, ... , m forms a basis of a vector space V if they span the space; any ue U can be expressed 
as a linear combination of the e;, u = Y%Li u i e i- Recall what a vector space is. If we adjoin a product 
□ with the right properties we get an algebra. Recall that for real, antisymmetric matrices are product 
was the commutator, making the algebra a Lie algebra. There are many more products we can think of 
in search of useful products— you'll see. Now for a little undergraduate linear algebra. 

A linear transformation on a vector space V is a map T: V -> V such that T(au + Bv) = 
aT(u) + BT(y), where u, v are vectors in V. Relating this to matrices, given a basis {ej of V, the map T 
has a concrete representation as a matrix D t j. This is defined by giving the transforms of each of the 
basis vectors e ; -. Because {ej form a basis, each such transform is a linear combination of the basis 
vectors, which we write in the form: Te ; = Aj e ;. We are using the Einstein summation convention 
whereby a summation over a repeated index is understood. Knowing the transforms of all of the basis 
vectors we are able to write down the transform of a general vectors u = u^, namely 
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Tu = T(ujej) = Uj(Tej) = u/Aje t . 

So, writing Tu = v = v^, we can identify v t = DijUj. 

Similarity. The matrix D was derived from T by reference to a particular basis {e} which (as we 
have seen by similarity transformations) is not unique (!). Let's review changing basis from {ej to {fj. 
We will obtain a different matrix D'. We define this by: 

rf. = n'..r. 
1 l i u ij l i> 

and the new coordinates of u defined by writing u = ujf • will be transformed to 

In matrix form this is v' = D'u' . On the other hand we may relate u' to u and v' to v by expressing 
each old basis vector e t as some linear superposition of the new basis vectors {f ; }: 

e = S f 

Thus 

U = U;e; = UiSjiij, 

so that 

Uj UiSji, 

or in matrix form, u' = Su. (Under a change of basis, do you see the contravariant transformation with 
Sji appearing to the left of the basis vectors, but sitting to the right of the contravariant vector 
components?) Similarly v' = Sv. Altogether then, v' = Sv = S(Du) = SD(S _1 u')- Clearly 
D' = SDS' 1 . 
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G-Module. If V is a vector space, G is a group 3 V g e G, T(g'g) = T(g')T(g), then G is a G- 
module. When we were working with continuous symmetries, G was the topological (continuous) group 
7 while G was the geometric manifold. 

Reducibility updated. In the language of G-modules and matrices, reducibility corresponds to 
the existence of a closed submodule: ue U c V => T(g)u £ U. Let {ej be a basis for U, i = 1,2, ... , m. 
We can extend this basis by {ej, i = m + 1, m + 2, ... m + n to form a basis of the larger space V of 
dimension m + n. 

Relative to this basis, the matrix D(g) corresponding to the linear transformation T(g) is given 
by T(g)ej = Dj ; (^)ej. The closure of U is reflected by D i; = when j = 1,2, ...,m when i = m + 
1, ... , m + n. That is, updating our matrix version of reducibility: 



For a finite group (and a compact group (later theorem)) C(g) can be set to zero. To prove this it is 
sufficient to show that all representations of a finite group are equivalent to unitary transformations. 

Scalar (dot) product. If V is a vector space with u, veV 3 c eC andc = (u, v), 




(u,v) = (v, u)* (hermitian) 



(u, u ) = (positive definite) 



(w, au + /?v) = a(w, u) + /?(w, v) (linearity) 



II u || = V (u, u) (norm), 



then (u, v) is the scalar (or dot) product. 
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Orthonormal basis (ONB). Given any basis {fj of a vector space V, it is possible to construct an 
ONB {ej 3 (e;, e ; ) = <5 £; -. The procedure is known as Gram-Schmidt orthogonalization: 

ei = fi/||f 2 ll 

_ , e!,f 2 
e2_f2 "I^II 

e3 = f3 ~j|^|~j|^||'--- 

Unitary transformations. A linear transformation T acting in V is unitary if (Tu, 7V) = 
(u, v) V u, v e V. The T(g) are necessarily invertible if the transformation is unitary. Equivalently, we 
can write 

(7u,v) = (u,r _1 v), 

and equivalently given D t j relative to some ONB {ej, we necessarily have Djj = (D _1 ) ; j. For unitary 
matrices = (D*) f = D _1 ; the complex, conjugate equals the inverse. For a hermitian matrix, 
D f = D. 

Complete reducibility in terms of an ONB. Now that we have a scalar product, we may choose 
the basis of V to be an ONB. Any vector w in the space W spanned by the additional vectors {ej, i = 
m + 1, ... m + n is orthogonal to any u \r\U: 

W = {w e V I (w, u) = OVueU}. 

In a coordinate-free language, complete reducibility corresponds to the closure of the subspaces U and 
V under scalar product. This is always true if the T(g) are unitary transformations wrt to the scalar 
product, for then 
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(7X<7)w,u) = (wj- 1 



(5)u). 



The closure of U then guarantees that T 1 (g)u = T(g x )u = u' e U. Hence (T(g)w, u) = (w, u') = 
0. Cleary then T(g)w = w' eW. 

Maschke's Theorem. All reducible representations of a finite group are completely reducible- 
decomposable into a direct sum of irreducible representations. (Hint: Use (cleverly create) a scalar 
product which always gives us a unitary representation.) 

Proof. Define the group invariant scalar product by building up from the original scalar 
product, but now sum over all group elements: 



The {v, v'} are generic members of V = U@W. Consider {T(/i)v, TQi)\'}, heG. The group invariant 
scalar product becomes: 



Just as was true for group invariant left (right) measures for continuous groups, Y, g = Y,'g f° r discrete 
groups. Thus we have 



Evidently, the T(h) are unitary wrt to the group invariant scalar product which was cleverly created to 
do exactly this. In terms of matrices, the T(h) will be realized as a reducible unitary matrix D'Qi) if we 




{T(h)v,T(h)v'} 




1 




{r(/i)v,T(7i)v'} = {v,v'}. 
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choose a basis {fj orthonormal wrt the group invariant scalar product, whose first members m span U. 
The D'(h) will be related by the similarity transformation D'Qi) = SD(/i)S _1 , where S is the matrix 
effecting the change of basis from {fj to {ej. (The representation D is equivalent to the reducible 
unitary representation D' , which is completely reducible.) In pictures: 



' ~ o \w 



What does this group invariant scalar product look like for, say, C 3 ? Let v = (a, b, d) and 
v' = (e,f,g) be vectors in M 3 . The usual scalar product is 

(ab d)-{ef g) T = {abc)- ^/j = ae + bf + eg. 

With our three-dimensional rotation matrix representation, the group invariant scalar product looks like 



geG 



(T(g)v,T(g)v') 



l/ 1 °\ 
=t 1 v 

\o o 1/ 



/_i __ o 

2 2 

V3 1 

T "2 





V 





0\ 




1 


L\o 


1/ 


\ " 


r / 




1 


v' 




/ . 


+ 3 

V 



1 

+ 3 



I- 1 - o\ 

2 2 

V3 1 

T ~2 ° / 

1/ 



-i * n\ 

2 2 
V3 1 







/- - 
2 2 

V3 1 



V 



2~ -F 





2 2 y 



Schur's first lemma. Any matrix which commutes with all the matrices of an irreducible 
representation is a multiple of the identity, 



BD(g) = D(g)B V geG => B = XI. 
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(Think in terms of the three matrices above.) In terms of linear operators, 

BT(g) = T(g)BVgeG => B = AE, 

where B: U -» U is the linear operator version of B, and E is the identity map u -> u. 

Proof. Let's work with the linear operator version. Let b be an eigenvector of B with 
eigenvalue/!: Bb = Ah. Then 

B(T(g)b) = T(g)Bb = T(g)Ab = A(T(g)). 

Then T(g) is an eigenvector of B with the same eigenvalue A. The space of all such eigenvectors is a 
vector space which is a subset of the space U. It's a G-module, being closed under the linear operators 
{Tig)}. 

By irreducibility, the only submodules are the space U or the identity 0. Since every linear 
operator B has at least one proper eigenvector, B is not mapping vectors to the identity. In the complex 
numbers, det(B — AT) = has at least one root A corresponding to an eigenvector b. Thus the space of 
eigenvectors of B with eigenvalue A is the whole space. So Bu = Au V u e U and B = AE as claimed. 

Schur's second lemma. Consider two inequivalent representations D and D'. In matrix form, 
Schur's second lemma states 

BD(g) = D'(g)B Vg eG => B = 6. 

The corresponding linear operator B will be a map B:U^>U' between two vector spaces, each with two 
different representations. In coordinate-free language, the equation above is 

BT(g) = T'(g)B Vg eG => B = 0, 
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where is the linear operator mapping every vector in U onto the null vector in U' (Ou = 
O'Vue U). 

Before we get to the proof, what is this lemma telling us? We have 2x2 two-dimensional 
representations of C 3 (and D 3 ) and we have 3x3 three-dimensional representations of these groups. 
They are inequivalent representations. The only matrix that makes 2x2 commute with 3 x 3matrices 
is the 6 operator above. This remains true for two inequivalent representations even if they have the 
same dimensionality. Recall the one-dimensional irreducible representations of C 3 , namely C 3 = 

D^ 1 ' © D^ 2 ' © D^ 3 \ There is no nonzero (one-dimensional) matrix B so that, say B • e 3 = e e ■ B. 

Proof. Case (1). Suppose dim U = n < dim U' = n' . Consider the action of T'{g)B on an 
arbitrary vector u of U. From the above equation 

T'(g)Bu = BT(g)u. 

Since U is a G-module, T(g)u e U. Thus, 

r(<7)(Bu) eBU 

which means that BU = Im B is a submodule of U'. But U' is, by supposition, irreducible. So BU must 
be either the whole space U' or the null vector 1 . We can exclude the first case because we assumed 
from the start that n < n' . As the image of U the dimension of m of BU can't exceed that of U. So 
m <n <n'. We're left with B = 0. 

Case (2). If n > n' then the kernel of the mapping is 

K = {k e U I Sk = 0'} 
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The kernel is a submodule of U since B(T(g))k) = T'(g)Bk = 0'. By the irreducibility of U, K is either 
the whole space U or it is the null vector 0. K must be nontrivial because the images of Be t of the n 
vectors of a basis of U cannot all be linearly independent since the mapping is reducing the 
dimensionality from n to the smaller number n' . Thus every vector u e U must satisfy Bu = 0'. 

Case (3). Let n = n'. Again the kernel K is a submodule of U, but it can't be the null vector 
because D and D' are inequivalent. Recall what I said about the situation when the kernel is the identity 
element, namely this means that the mapping is 1-1. We just assumed that D and D' are inequivalent. 
We conclude that B = 0. 

Physicist's aside— at this point Georgi connects Schur's lemmas with quantum physics. 

Georgi's version of Maschke's theorem is that every representation of a finite group is completely 
reducible. His proof involves the use of a projector operator P such that PD(g)P = D(g)P V g G G. 
(This is the condition that P be an invariant subspace.) Georgi presses to a combined version of Schur's 
lemma: if D x {g)A = AD 2 (g)V g £ G where D x and D 2 are inequivalent irreducible representations, 
then A = 0. Then Georgi shows that Schur's lemmas have strong consequences for the matrix elements 
of any quantum mechanical operator that corresponds to an observable that is invariant under the 
symmetry transformations. This is because the matrix elements (a,k,x\0\b.k.y) behave like the A in 
Schur's lemma. The details of this connection are shown from the middle of page 14 to the middle of 
page 17 (2 nd ed.). The rest of Georgi's chapter 1 is in parallel with the Jones-based notes presented here 
on finite groups, but using Dirac bra-ket notation and projection operators. End physicist's aside. 

Fundamental orthogonality theorem— with examples. Let U v and be two G-modules 
carrying inequivalent irreducible representations of some given group G. (The indices may be 
continuous for compact groups, but let's let them be integers.) Pick an arbitrary linear mapping A from 
U v to f/ M and construct (yes we construct) the following operator 
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B = > TM^AT^tg- 1 ). 



a 

This involves the same (scalar product) sum that was constructed to make T^(g) unitary (under this 
constructed scalar product). (For compact groups we replace the sum with J dfi(g); review Part III.) 

Let h be any member of G and consider 



a 

Notice that this involves the same sum over group elements used in Maschke's theorem. Thus, 



a 

from the group property of the T^. Let hg be g' . Then the argument of becomes g -1 = g'~ x h, 
and we know the sum over g is the same as the scrambled sum over g' . Thus 

TW(h)B = Y TM( g ')AT M (g'- 1 h') = V T^(g')AT M (h) 



a a 
from the group property of the T^. Notice the first three factors, summed over g' give B again. Thus 

T^\h)B = BTWQi). 

Evidently B satisfies the conditions of Schur's second lemma; thus V = 6 unless \i = v. In the latter 
case the two representatives are the same. Well then Schur's first lemma applies, yielding B = AE. 
This can be expressed in matrix form as 







a 
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The constant A depends both on the label of the irreducible representation and on the choice of matrix 
A, which remains unspecified. Let's make life easy by specifying all elements of A to be zero except for 

A rs = 1. So now write A^ as A^ s . Then the ij matrix element of the sum above reads 



The A^ can be found by setting v = fi and tracing (contracting with Sij summation that is). This gives 



where is the dimensionality of D^^. The matrix (g V g is just the unit matrix with 

matrix elements <5 rs . Thus [g]S rs = . Substituting for 4? in Z 5 Djf ) (g)D w (g~ 1 ) = A^fs^l, 

we obtain the fundamental orthogonality relation for the matrices of irreducible representations as the 
equation below: 

[g] 



y>? } (a)D$\g- 1 ) = [ fs^s i jS rs 



What does Y, g D^(g)D^\g) = ^-8^ SijS rs look like? Is the result independent of the 

matrix representation? Consider for example the two-dimensional 2x2 representations of the 
dihedral group D 3 : 

Explicitly (with fi = v so tha S^ v = 1 the LHS of the sum is 
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a 

+ D%\b)D$\b-i) + D%\b 2 )D%\b^) + D%\b 3 )Dfb^). 
Let, say, i = j = r = s = 1. Then 

+ DffWDffCi,- 1 ) + D%\b 2 )D<Z\b^) + D^dbM^bs 1 ) 

1111 [g] 6 

= 1 + - + - + - + -+1 = 3 = RHS = — = - ^"ffnffn. 
4 4 4 4 n M 2 11 11 

What about t = y = r = 1; s = 2? Then 

+ DgtoDgQ,- 1 ) + D^\b 2 )D^(b^) + d{?0> 3 )<V) 

1 V3 / 1\ / V3\ 1 V3 1 / V3\ [a] 
= l'O--- I — ' — V + — V + T- -V -1-0 = = RHS = — 



6 

= -5 5n5 12 . 



We'd get similar results using a three-dimensional 3x3 matrix representation for D 3 : 



/l 0\ /0 1\ /0 1 0\ /0 1 0\ 

e= 1 0, c= 1 0, c 2 = 1, b = \\ 0, 

Vo 01/ Vo i o/ Vi oo/ Vo o 1/ 


























1 




Vo 


1 


0/ 







0/ 



Let, say, i=j = r = s = l. Then 
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+ D^\b)D^\b-i) + D%\b 2 )D%\b^) + D^\b 3 )D^) 

[g] 6 „ 

= 1 + + + + + 1 = 2 = RHS = — = -S^S^S^. 

n ,> 3 



What about i = j = r = 1; s = 2? Then 

+ D^C^Or 1 ) + D%\b 2 )D<£\b^) + DjpCWDgV) 

= + + + + + = = RHS = — = ^S^SuSv 

n M 3 

What about i = j = 1; r = s = 2? Then 

[^] 6 „ 

= 1 + + + + + 1 = 2 = RHS = — = -S 11 8 11 S 22 . 

n,' 3 

Without explicitly plugging in, I get a headache with the abstract linear algebra. 

Restriction on the number of irreducible representations. With what we have just learned 
there is no loss in generality if we let the representations of and be unitary (because we can 
always make a unitary scalar product.) Then our result above becomes 



9 
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Don't let your eyes not see the star up there thanks to Maschke's theorem. 

Fix your attention on and set v = fi. For fixed i and r the set of objects {D^P^g^, ■ ■■,D^\g[ g ])} 
can be considered a [g]-dimensional column vector. Then the LHS of the sum represents the complex 
scalar product of two vectors in this space, labeled by the pairs of indices (ir) and (js) respectively. 
Each of these indices takes values from 1 to n M , the dimensionality of There are of these 
vectors, and by the sum (scalar product) above, they are all orthogonal. The same applies for any other 
value of \i, say //, and moreover, the vectors formed by the D^') will be orthogonal to those formed by 
the D^. Accounting for all possible values of [i we can form a total of Yn n ]i mutually orthogonal 
vectors. The number of such vectors cannot exceed the dimensionality of the space, this being [g]. We 
have therefore proved that £ M < [g]. (Later this will be shown to be an equality.) Since each n M 
must be at least 1, the number of irreducible representations of a finite group is strictly limited. Want to 
understand this? Plug in our D 3 example. 

Orthogonality of characters. Recall that the character of a representation D is the set [xig)} 
where x(g) is the trace of the matrix D(g). From linear algebra, the traces also have the properties: 

X is the same for equivalent representations connected by a similarity D'(g) = SD(g)S _1 . 

1- X is the same for conjugate elements (of the same conjugacy class) since 

2- DQigh- 1 ) = D{K)D{g){D{h)Y\ 

3- lf D is unitary (D' 1 = D A t) thenxig' 1 ) = Tr ((D(#)) _1 ) = Tr(D(g') t) = (This result is 
always true for finite or compact groups since any representation is equivalent to a unitary 
representation.) 
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The orthogonality relation for characters is obtained by taking suitable traces of the 
fundamental orthogonality theorem— the orthogonality results for the matrices pass through to their 
traces, and further constrain our algebra . Tracing over i, r and s,j (multiplying by S ir S s j gives 



T x w (g)x iv \g- 1 ) = —s^StjStj 



Here S^Sy = S u = n^. The summation convention is always operative as the indices range from 1 to 
n^, the dimension of the irreducible representation. Thus, 



a 



By virtue of the third property we listed for the traces of x, this sum can be recast in the alternative form 

^^x^\g)x {v) \g) = s^. 

a 

Thus up to a factor of [g], the LHS of the equation is the usual complex scalar product of the two [g]- 
dimensional column vectors {^^(jj^.X^iSi)' ■■■ So ' ts both convenient and illuminating to 

define the scalar product of two characters <p, x by 



(<p,x) = jj^(P(g)x(g 1 ) = (x,<p)- 

a 



In this language j-^LgX^ (#) X^id 1 ) = ^ v states that the characters of inequivalent irreducible 
representations are orthonormal: (x^, X^) = <^ v - 



Given that the characters of conjugate elements are equal, all elements of a conjugacy class have the 
same character, so the distinct characters may be labeled as Xu i = 1< ■■■ , k. These correspond to ht k 
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conjugacy classes K t . Let k t be the number of elements in the conjugacy class K t . Then the sum over g 



But this can now be interpreted as orthogonality of the vectors -Jkixi (no summation) in k- 
dimensional space. And since there are no more than k such vectors, we have another inequality on the 
number r of different irreducible representations: r < k. (This turns into an equality (See "Group 
Theory and its Applications to Physical Problems," M Hamermesh, Addison-Wesley, out of print.)) The 
characters can be shown to be orthogonal wrt the index i as well as in the sense that 



This gives the inequality in the opposite direction, thus leading us to the inescapable conclusion that 
r = k. 

Decomposition of Reducible Representation. For a finite or compact group, any reducible 
representation is reducible into the direct sum of irreducible representations, meaning that the 
representation matrices can be put in block diagonal form, the nonzero diagonal blocks being the 
matrices of the irreducible representations. A given representation may appear more than once, e.g., a 
5-dimensional representation could decompose into a trivial representation and two copies of the same 
2-dimensional representation. Generally we may write 



in ri^s X^id)X^ (g) = ^ v can be rewritten as a sum over i: 
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where the non-negative integers a v denote the number of times a particular irreducible representation 
of appears in the decomposition. Let's go find these a v . We will do so by using the orthogonality 
properties of the characters x^- Taking the trace of both sides of the sum above for an arbitrary group 
element g, we can see that the characters xig) of D decomposes as an ordinary sum of the characters 

J (v) ; 



Let's dub x a compound character, and the x simple characters. Multiply the sum above by 
X^ig -1 ) and sum over g to get 




a 




x w (g- 1 Mg)=? a v ) x^g-^igl 




a 



V 



a 



Using ^Ll M (5k ( %" 1 ) = <5" v ,the RHS is just £ v a v [gW v = [g]a„. Thus 



^^xig^Xg- 1 ). 

a 



All of this amounts to writing 




a 



and taking the scalar product (x^, x) t0 obtain 



which is the shorthand version of the sum for a, 
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Regular representation. Recall Cayley's theorem? There is an isomorphism between a group G 
and a subgroup of the permutation group S^j provided by left multiplication. That is 

99i = ^Dj i (g)g j . 

i 

The [g] x [g] permutation matrices Dj ; (^)form a [g]-dimensional representation of a group called 
regular representation. Now gg t is an element of G, say it's g x l± i except when g = e. We see that 
Dji(g) has only one non-zero element in each row and each column. For g e, all these elements are 
off diagonal (Z i), while for g = e, they are all diagonal. In fact D ;i (e)is the unit matrix Sji. 

Example 6— In C 3 



c 3 


e = 9i 


c = 92 


c 2 = 93 


D (l) 


1 


1 


1 


D (2) 


1 


0) 


a) 2 


D (3) 


1 


c 2 





Recall that 

/0 1\ /l 0\ /0 1 0\ 

D(c) = 1 , D(e)= 1 , D(c 2 ) = 1. 

VO 10/ VO 1/ Vl 0/ 

This is the regular representation for C 3 , there the dimensions of the matrix match the order (size) of C 3 . 

Now we decompose the regular representation into its irreducible components D = £ ffi a v D^ v \ 
The coefficients are given by = (x^\x)'- 

9 
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0, g ± e 
g = e. 



From the special form of the we deduce 
Therefore^ = x^(. e ) = ?V the dimensionality of D^- 1 . Putting g = e in 



results in 



[g] = ^ n v ■ n v = ^ nl 

V V 

making D^n^ ^ 9 an equality. For g 3= e, we instead get 

= ^^(5) 

V 

and the last two equations can be combined as 



So what we did in "The example (5)" was to use the tools: 
1. The number of irreducible representations equals the number of conjugacy classes. 

3. Orthogonality: £ k iX f X^* = [gl 

4. Whatever tricks we can use. 



Example 7— (Please compare this example with the equivalent material in Georgi's text.) The 
character table of D 3 . The conjugacy classes for this group were /q = [e], k 2 = [c, c 2 ], and 
k 3 = [b, be, be 2 = b, b 2 , b 3 ]. Tool 2 states that n 2 + n 2 + n 2 = 6, but there is always a trivial group 
of size 1. This leaves n 2 + n 2 = 5. Eyeballs tell you, WLOG, that n 2 = 1 and n 3 = 2. This enables 
us to fill the character table in since ( e ) = ?V F° r the one-dimensional representation the x's 
must mimic the group structure, so x(pc) = x(b)x( c )- Note that = x(bc) = Xz- Thus 
Xic) =X2 = I- Further,^) 2 = x(b 2 ) = X (e) = 1, giving * 3 = -lforD®. Using (1), (2) and (4) 
gets us this: 



^3 




fe 2 


k 3 


D (D 


1 


1 


1 


D (2) 


1 


1 


-1 


D (3) 


2 


a 


P 



Let's use orthogonality (3). The orthogonality of x^ with x^ an d gives(via dot product): 

2 + 2a + 3/? = 
2 + 2a-3/? = 0. 

The coefficients in the equations are the multiplicities of k x and k 2 of the respective conjugacy 
classes. The equations yield a = — 1 and /? = 0. (The three characters should be orthonormal.) 

We need the matrix of at least one of the bs. WLOG let b be rotation about the x-axis: 

D^ R3 =diaga-l,-l). 
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This corresponds to x' = x, y' = y, z' = —z. TrD v (b) = x v = — 1- So x v = (3,0,-1). The 3 is the 
trace of the identity element in conjugacy class the is the trace of the conjugacy class [c. c 2 ], and 
the -1 is the trace of the conjugacy class of [b, b 2 , b 3 ]. Thus 

X V=R3 = x {2) + X (3 \ hence, D v = D™ © 

The basis functions of and can be reasoned out. We've noted that z changes sign 
under b, but it's left invariant under c. Hence z forms the basis for D®. The two-dimensional 
representation gives the transformation of x and y, but unlike for C 3 , and precisely because of the 
rotations b, b 2 and b 3 , these transformations can't be further broken reduced. Let's do some checking: 



1 




3 


2 


[1 1 1] 





.3. 




-1. 



= -[!(!) + 2(1) + 3(1)] 



3 


-1 



= 0, D^row in table; 1 — dimensional. 



a 2 =-[!(!) + 2(1) + 3(-l)] 



3 


-1 



= 1, D^row in table. ; 2 — dimensional. 



a 3 = -[1(1) + 2(1) + 3(0)] 
6 



3 


-1 



= 1, D^row in table, 3 — dimensional. 



So D v=r3 = D®0D® = 2 e a v l)M. * = £ v a v j^ = • X W + 1 ■ X {2) + 1 ■ * (3) - 

Please see the Jones text, chapter 5 for applications to Ferromagnetism and Ferroelectricity 
(D v = © © D( 3 \) Also in this chapter is a study of the molecular vibrations of water, and the 
breaking of degeneracy by the addition of an interaction Hamiltonian to the "free" Hamiltonian which is 
invariant under some group G. If you have a background in quantum physics in Dirac's bra-ket 
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formalism (there is a quick review in the appendix of Jones) you have sufficient background to 
understand the first chapter of Georgi's text, which contains the identical material BUT in Dirac's bra-ket 
notation, and the definition of projection operators together with a great physical example of the power 
of these methods for discrete groups. The remainder of Georgi then tackles continuous (Lie) groups, 
this material being paralleled with Jones from chapter 6 to its end. This latter material is what you need 
to grasp not only the Standard Model of physics, but its generalizations starting with SU(5) grand 
unification theory (the SU(5) GUT). I strongly recommend you read the group theoretic material (in the 
appendix as well) of Michio Kaku's text, "Quantum Field Theory, A Modern Introduction," Oxford, 1993. 
Review and make sure you understand the quantum mechanics of spin and angular momenta, spinors 
and tensors at the level of "Quantum Mechanics," Vols. I and II by C. Cohen-Tannoudji, B. Diu, and F. 
Laloe, A Wiley-lnterscience Publication, 1977. 

Thankfully, only two more algebraic blocks remain in these notes. The first chapter of Gilmore's 
2008 text tying what we've just studied to Galois theory follows next. This is proceeded by a few notes I 
wrote to make "Lie Algebras in Particle Physics," by H. Georgi more readable starting with his chapter 2. 
I consolidated his sloppy book with the appropriate chapters from the treatment of continuous groups 
in Jones (chapter 6-end), and may one day write up these latter notes. For now we turn to Galois 
theory. The coverage of this material will be fast paced. Then it's on to the last notes on group theory 
covering the adjoint representation of the Gell-Mann matrices. 

Galois theory. 

Galois' theorem: A polynomial over the complex field can be solved iff its Galois group G 
contains a chain (tower) of subgroups C = G d Cj d ••• d G u = I 3 G i+1 A G t and Gi/G i+1 isabelian. 
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Quadratic Equation . Take (z — r x )(z — r 2 ) = 0. This is z 2 — 7 x z + 7 2 , where 7 X = r x + r 2 , and 
7 2 — r 1 r 2 . Both invariants 7 2 are symmetric under the permutation group S 2 with character table: 



s 2 


E 


(12) 


r 1 


1 


1 


r 2 


1 


-1 



We use the character table to make linear combinations of r x and r 2 : 

(1 1\ ( r i\ _ /Tl + f 2 \ 
VI -1/Vr 2 ; Vr!-r 2 / 

The sum is invariant under the identity E, but the difference r x — r 2 is not invariant under the two-cycle 
(1 2): (r x — r 2 ) = — (r x — r 2 ). 6yf S 2 is abelian (it "increases the symmetry" if you will). There exist a 
function of two symbols symmetric under (1 2) because of the commutativity of S 2 . Let's try 
(r x - r 2 ) 2 . 

0i - r 2 ) 2 = r x 2 - 2r x r 2 + r 2 2 = rf + 2r x r 2 + r 2 2 - 4r x r 2 = 7 2 - 47 2 = D, 

where D is the discriminant of the quadratic equation. Now check out the action of the character table 
rephrased: 

(l -l)(r 2 ) = (±V7 1 - 47 2 ) 

Note that the RHS column vector is symmetric under both the identity E and S 2 , moreover both 
solutions can now be seen as functions of the two invariants 7 X and 7 2 . We have found solutions by 
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adding/subtracting, multiplying/dividing and extracting roots. This is what is meant for a polynomial to 
be solvable by "radical extension." 



ri,r 2 = ^{h±4D). 



The character table, by the way, is an orthonormal rotation matrix which preserves lengths. The Galois 
group is the abelian group S 2 . It has a tower (or chain) ending in the identity element: 



S 2 
I 
e 



If you recall e A S 2 . We will see that the tower of the group of a given polynomial will have much to do 
with its solvability. 

Cubic Equation . Take (z — Si)(z — s 2 )(z — s 3 ) = z 3 + l x z 2 + I 3 z — I 3 = 0, where 

I t = S 1 + S 2 + S 3 , I 2 = 5 X 5 2 + S 1 S 3 + S 2 S 3 , I 3 = S 1 S 2 S 3 . 

The Galois group is S 3 with the subgroup chain as shown: 

S 3 = £3 
A 3 = C 3 i S 2 
e 

Note that e A^4 3 A S 3 . The existence of this tower is the first of two conditions of Galois' theorem on 
the solvability of polynomials by radical extension. I'm sneaking in the theorem by example. Also note 
that S 3 /A 3 = S 2 is abelian, as is A 3 /e = A 3 . This is the second condition of Galois' famous theorem. 
Now we know that there is a solution to the cubic by radical extension. 
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We begin with the solution of the last group-subgroup pair in the chain (or tower). We know 
how to derive the character table for C 3 = A 3 (recall "The BIG example (5)": 



A 3 = C 3 


e = E 


c = (123) 


c 2 = (321) 


r (D 


1 


1 


1 


F (2) 


1 


0) 


a) 2 


f(3) 


1 


u 2 









"1 


1 


1 




Si 








1 


0) 


6) 2 




s 2 




?3. 




.1 


CO 2 


0) . 




1*3. 





Since at 3 = 1, recall that there were three roots of unity. Note also that The P form a group isomorphic 
with A 3 = C 3 . Linear combinations of the roots that transform under the three one-dimensional 
irreducible representations are easily constructed using the character table: 

Sj. + s 2 + s 3 

Si + (JL>S 2 + (JL> 2 S 3 

S x + 0) 2 S 2 + cos 3 

For example, the action of (1 2 3)" 1 on i; 2 is 

(1 2 S) -1 ^ + a)s 2 + oj 2 s 3 ) = (3 2 l)(s! + o)s 2 + (jl> 2 s 3 ) = a)(5 x + u>s 2 + a) 2 s 3 ) = u>v 2 . 
Since v x is symmetric under both A 3 and S 3 it can be expressed in terms of the invariants I k : v x = / x . 
The remaining functions v 2 and v 3 are symmetric under I but not umnder A 3 . 

Proceed to the next group-subgroup pair S3 3 A 3 as before. To construct functions symmetric 
under A 3 but not under S 3 note that the cubes of v 2 and v 3 are symmetric under A 3 but not under S 3 : 

(1 2)vf = (1 2)0?! + 0)S 2 + 0) 2 S 3 ) 3 = (S 2 + OJSi + a) 2 s 3 ~) 3 = OJ 3 (Si + 0) 2 S 2 + 0)S 3 ) 3 = v\, 

(1 2)v| = (1 2)(s x + a) 2 s 2 + a)s 3 ) 3 = (s 2 + a) 2 s Si + a)s 3 ) 3 = a) 6 ^ + a)s 2 + a) 2 s 3 ) = v\. 



243 



Since S 2 = S 3 /A 3 permutes the functions v\ and v\, it is the Galois group of the resolvent quadratic 
equation whose two roots are v\ and vf . This equation has the form: 

(x - vl)(x - v%) = x 2 -hx+J 2 = 0, 

A = v\ + v\, ] 2 = v\v\. 

(We know how to solve quadratic equations.) Take note that ] x and J 2 are symmetric under S 3 . They 
can then be expressed in terms of the invariants I v I 2 and I 3 of the original cubic equation as follows: 

A = ^ A ijk^2^' 
i+2;'+3fc=3 

J 2 = Bijklill 1 !;- 

l+2;+3fc=6 

This sum can be greatly simplified by letting I r = s t + s 2 + s 3 = 0. To do this, shift the origin with 
z = y + -/ x . Then the auxiliary cubic equation has structure 

y 3 - Oy 2 + V x y - 1' 3 = with 
I[ = s[ + s 2 +s 3 = 0, 

I 2 =s[s 2 +s[s 3 +s 2 s 3 = I 2 -^ll 
1 2 

A = S 1 S 2 S 3 = A — 3 AA + 27 A- 

The two invariants ] x = v\ + v 3 and J 2 = v 2 v 3 can then be expressed in terms of the invariants 
I 2 and I 3 as follows: 

A = v\ + v! - -2111 ] 2 = v\v\ = -21V 2 \ 
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The resolvent quadratic equation whose solution provides v\, v\ is x 2 — (— 277 3 )x + (— 277£ 3 ) = 0. 
The two solutions to this resolvent equation arev 2 , vf = - y/g + ^ [(277 3 ) 2 + 4 x 2 77 2 3 ]2. The roots 



v 2 and i? 3 are obtained by taking the cube roots of v 2 and v 3 



3. 



i 

1-13 



"1 


1 


1 




Si 




Vi 




1 


<y 


/ 1 2 

to 








v 2 




.1 




to . 




S 3 . 




v 3 . 





v 2 , v 3 = {- y 7 3 ± - [(277 3 ) 2 + 4 X 27/^ 3 ]2j 
Finally the roots s x , s 2 and s 3 are linearly related to v Xl v 2 andv 3 by: 



v t + v 2 + v 3 

V x + 0) 2 V 2 + 0)V 3 
V x + U)V 2 + (Ji) 2 V 3 



Quartic equation . The general quartic has form 

(z - tJCz - t 2 )(z - t 3 )(z - t 4 ) = z 4 - 7 x z 3 + / 2 z 2 - 7 3 z + 7 4 = 0, 
7i = ti + t 2 + t 3 + t 4 , I 2 = t t t 2 + t 1 t 3 + t 1 t 4 + t 2 t 3 + t 2 t 4 + t 3 t 4 , 

^3 = ^^2^3 + ^^2^4 "I" fl^3^4 + ^2 ^3 ^4< ^4 = tl^^^- 

For later convenience we will construct the auxiliary quartic by shifting the origin of coordinates by 
z = z' + -7 X (Tschirnhaus transformation). The 
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(z' - t x )(z' - t 2 )(z' - t 3 )(z' - t 4 ) = z' 4 - 7{z' 3 + V 2 z' 2 - 7 3 z' + 7 4 = 0, 



/4 = /4-^ 3 /l+^/ 2 /l 2 -^/l 4 

The Galois group is S 4 . It looks like: 







s 4 








/ 


1 


\ 








A 4 






i 


/ 






i 


V 4 


\ 


I 


/ 


s 2 



The tower (or chain) is e A V 4 AA 4 AS 4 . (V 4 is the vieregruppe, Klein group, or Klein four-group: { 11,(1 
2)(3 4),(1 3)(2 4),(1 4)(2 3)}. This satisfies both conditions of Galois' theorem: 

(i) A 4 is invariant (normal) in S 4 and -f- = 5 2 . 

(ii) V 4 is invariant (normal) in A 4 and ^ = C 3 = {E, (2 3 4), (4 3 2)}. 

(iii) E is invariant in V 4 and 7 = ^ 4 = {E, (1 2)(3 4), (1 3)(2 4), (1 4)(2 3)}. 

As before, begin at the end of the chain with the abelian group V 4 with character table given by: 





E 


(1 2)(3 4) 


(1 3)(2 4) 


(14)(2 3) 


Basis functions 


r 1 


1 


1 


1 


1 


ci) 1 = t x + t 2 + t 3 + t 4 


r 2 


1 


1 


-1 


-1 


^2 = h + ^2 — ^ 3 — ^4 


r 3 


1 


-1 


1 


-1 


^3 = f l + f 2 — f 3 — f 4 


p4 


1 


-1 


-1 


1 


0) 4 = — t 2 — t 3 + t 4 



The linear combination of these roots that transform under each of the irreducible representations are 

246 



&M mi i 11 rtii rt x + 1 2 + 1 3 + t 4 

^2^1 1 -1-1 t 2 _ t X + t 2 - t 3 - t 4 
6J 3 1-11 -1 t 3 t! + t 2 - *3 - *4 ' 

.^J Li -1-1 1 J U 4 J Ia - 1 2 - 1 3 + 1 4 . 

These basis vectors are symmetric under E but the basis vectors co 2 , co 3 and co 4 are not symmetric under 
V 4 . Thus we now move up the chain to A 4 3 V 4 . 

We seek to construct from the above linear combinations functions that are 

(i) Symmetric under V 4 

(ii) Permuted among themselves by A 4 and the group A 4 /V 4 . 

These functions are = E and co\, co\,co\. In the coordinate system in which the sum of the roots is 
zero, the three functions co\, co\, co\ are 

co\ = (t{ + t 2 + t 3 + t' 4 f = 2 2 (t{ + t' 2 f = -4(t{ + t 2 )(t 3 + t 4 ), 

o>l = (t{ - t 2 + t 3 - t 4 ) 2 = 2 2 (t{ + t 3 ) = -4(t{ + t 3 )(t 2 + 4), 

^ 2 = (t{ - 1 2 - 1 3 + t 4 ) 2 2 2 (t; + t 4 ) 2 = -4(t{ + t 4 )(t 2 + 1 3 ). 

It's clear that the col "1 a>l are permuted among themselves by the factor group C 3 = A 4 /V 4 , which is 
a subgroup of the Galois group of a resolvent cubic equation whose three roots are co\, co\,co\: 

(y - ^l)(y - fj 2 )(y - ^1) = y 3 -Jiy 2 +J 2 y -h = o, 

J 1 = 0)1 + Cx)l + (Ol, Jl = <^2<A + ^2^4 + ^3^4< /s = CO 2 ^3 ^4- 

Since the J's are invariant under C 3 , they can be expressed in terms of the symmetric functions 
(coefficients) of the original quartic (either one): 

A = (-4) X (2/D, 
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/2 = (-4m 2 -4/n 

; 3 = (-4) 3 (-/ 3 3 ). 

This cubic equation is solved by proceeding to the first group-subgroup pair in the chain: S 4 3 A 4 with 
— = S 2 . The cubic is solved by introducing the resolvent quadratic of the previous section. If the three 
solutions of the resolvent cube are called y x , y 2 , y 3 , then the functions co\, &>|, a)| are 



A simple calculation shows that (jl> 2 (jl> 3 (jl> 4 = 8/3. The signs are selected so that their product is 

8/3. The simple linear relation between the roots t t and the invariants / x and functions is easily 

inverted: 



1111 
11-1-1 
1-1 1 -1 
1-1-1 1 





"V 




&>2 




6J3 







where the a)_j are square roots of the solutions of the resolvent cubic equation whose coefficients are 
functions of the auxiliary quartic. 

Insolvability of the quintic. The Galois group for the general quintic is S 5 . It's tower is 
E A A 5 AS 5 . Although S 5 /A 5 is commutative, here is the rub: A 5 /l is not abelian. This tower doesn't 
satisfy Galois' theorem. Let's discuss this. Given a polynomial of n th degree in a factorized form, it is 
trivial to construct invariants that are symmetric with S n , e.g., for n = 5, 

(z - 7i)(z - r 2 )(z - r 3 )(z - r 4 )(z - r 5 ) = 0, ^ = ^ + r 2 + r 3 + r 4 + r 5 , 

h = r i r 2 + V3 + V 4 + r x r 5 + r 2 r 3 + r 2 r 4 + r 2 r 5 + r 3 r 4 + r 3 r 5 + r 4 r 5 , 
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/ 3 = ri r 2 r 3 + r x r 2 r 4 + r ± r 2 r 5 + r 2 r 3 r A + r 2 r 3 r 5 + r 3 r 4 r s , 
I 4 = r^r^ + r^r^s + r 2 r 3 r 4 r 5 , I 5 = r^r^r^ 

However, we often only know the coefficients/;, i = 1, ... , n, e.g., y 5 — 3y 4 + 2y 3 — y 2 — -y = 0. The 

task, then, is to find the n roots by radical extension as we have done for the quadratic, cubic and 
quartic given only the coefficients I t . This is a constructive process called field extension, in which we 
seek solutions by using arithmetic operators and raising quantities to positive integer powers. In this 
sense, as with the restriction of geometric constructions to straightedge and compass, we quickly run 
into things we can't construct (polynomials we can't solve by radicals). 

The problem with the quintic is that we know (if given five roots r x , r 2 , r 3 , r 4 , r 5 ) that we may 
construct five invariants (see above) symmetric wrt S 5 . When we know only the coefficients l it the 
process to find the five roots begins at the group-subgroup pair ending with the identity: E A A 5 to 
construct invariant functions that are invariant with E but not with A 5 . The character table for A 5 
produces a set of basis functions that are invariant under E but not with A 5 . Then we seek to construct 
from these basis functions linear combinations that are symmetric under A 5 and permuted among by 
the group S 5 /A 5 . But A 5 is nonabelian, rendering it impossible to construct invariants symmetric with 
A 5 using addition/subtraction, multiplication/division, raising by integer powers. Let's make this crystal 
clear. Back at the cubic the character table was: 



A 3 = C 3 


e = E 


c = (123) 


c 2 = (321) 


r (D 


1 


1 


1 


r (2) 


1 


O) 


CO 2 


f(3) 


1 


CO 2 


0) 



Did you notice the r £ 's form a group? 
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= A, 




f(2) 


f(3) 


r (D 


r (D 


r (2) 


F (3) 


f(2) 


f(2) 


r (3) 


r(i) 


r (3) 


r (3) 


r (D 


r (2) 



Under a scalar product, r (2) r (3) = (1 + co + go 2 ) ■ (1 + go 2 + go) = 1 + go 3 + go 3 = 1 + 1 + 1 = r (1) . 
r (2) r (2) = (i + 0) + (O 2).(i + (O + (O 2) = i + (O 2 + (O = r®. Of course r (1) r (2) = T (2) . Either 
T^ 2 ^ or generate the rest of the group (which is isomorphic to A 3 ). A 3 is abelian moreover, hence 
it is cyclic. When we used the character table of A 3 to build invariant functions, we didn't lose any 
elements of A 3 . 



1 


1 


1 




Si 




1 


OJ 


GJ 2 




s 2 




.1 


GO 2 


G) . 




S3. 





s x + s 2 + s 3 

Si + G)S 2 + G) 2 S 3 
S x + G) 2 S 2 + G)S 3 



On the other hand A 5 is not cyclic because it is nonabelian. Its character table has Os. When we 
multiply its character by a column vector of roots to make invariant functions from the roots we lose 
terms 



-1 


1 


1 


1 


1 - 




3 





1 + V5 


1- V5 


-1 


-r r 


2 


2 


r 2 


4 


1 


-1 


-1 





r-3 


3 





1 - V5 

2 


1 + V5 
2 


-1 


r 4 


5 


-1 








1 - 





r x + r 2 + r 3 +r 4 + r 5 

1 + V5 1-V5 
3r x + ■ r 2 + — - — r 3 + — - — r 4 - r 5 

4r x + r 2 — r 3 — 4r 4 + ■ r 5 

1-V5 1 + V5 
3r x + ■ r 2 + — - — r 3 + — - — r 4 - r 5 

5r x — r 2 + ■ r 3 + ■ r 4 + r 5 



The first linear combination involves all of the five roots, but none of the other combinations contains al 
five roots. So are missing more than one root. To see a solution to the quintic by radical extension, we 
need to construct functions MADE FROM the second, third, fourth and fifth equations above that are 
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invariant under the interchange of symbols. Impossible. Hence the quintic is unsolvable by radical 
extension. 

Be water my friend. "One step beyond the solvable equation," Sander Bessels, PhD dissertation 
2006, uses Galois theory, Klein's icosahedron and elliptic curves to solve the general quintic. To the 
symmetries of the Standard Model, physicists have added supersymmetry (SUSY). Many infinites have 
died. Let's proceed to the last of the algebraic blocks. After dealing with discrete groups, Jones 
proceeds to continuous groups. These notes provide several step-by-step examples that detail the 
theory developed in Jones and, supposedly, in H. Georgi's book on Lie algebras in particle physics from 
Isospin to unified theories. 

Self-contained algebra prerequisites for the Standard Model, GUTs and TOEs. We will study 
SU(2) and SU(3) in detail via tensor product and direct sum matrix mathematics, ladder operators and 
Young's tableaux. This is where your background in junior or senior level exposure to quantum 
mechanical addition of angular momentum will come in handy. It is your option whether you read the 
material on the Wigner-Eckart theorem, which is useful for computing selection rules. What we learn 
from SU(2) and SU(3) will then be generalized to study the Cartan subalgebra, the attendant ladder 
operators, the Killing form, root and weight diagrams and Dynkin diagrams. These are the tools to 
"play" group theory with theories beyond the Standard Model, e.g., SU(5) or Lissi's TOE. 

Basics [Highly augmented with my notes the following material is excerpted from "Spin and the 
addition of angular momentum using tensor notation," Joel C. Corbo, 2007]. The aim of this section is to 
see the explicit connection between the coupled and uncoupled basis (between tensor products and 
direct sums that is). The spin operators S x , S y , and S z have commutation relations given by 

[S^Sy] ihS z , [Sy,S z ] ihS x , [S z , S^] ifiSy. 
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The above also holds for orbital angular momentum, but unlike spin, orbital angular momentum only 
takes integer values. Pauli proposed the following matrices with the same commutator algebra: 

= M i\ = h, _k h (1 ox 

You may verify the commutation relations hold for these matrices. Let S 2 = S% + Sy + S z . 
In matrix form we have 

Verify S 2 matrix commutes with S x ,S y , and S z . Wrt the z axis let's define spin up and down states by 

2 2/ = (o) ' 2 ~ 2/ = (l)" 

We see that the spin up eigenvector (or eigenstate) Q^j has eigenvalue ^ ft for the matrix S z . The 
eigenvalue for the spin down eigenvector has eigenvalue ^ ft for matrix 5 Z . 

Please refer to a good textbook in quantum mechanics such as "Quantum Mechanics," Claude 
Cohen-Tannoudji, Bernard Diu and Franck Laloe, or "Modern Quantum Mechanics," JJ Sakurai for the 
required background to the following material on where matrices such as the Pauli matrices come from. 
The matrix algebra is very easy to follow. For the operator S z let 

S z \sm s ) = m s h\sm s ) 

where s can be a positive half integer or positive integer and m s takes on all values between — s and 5. 
(Clearly we are generalizing beyond the spin Vi electron.) Then Pauli matrix S z for, say, the electron is 
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(Ill 1 1\ 111 1 1\\ / 1 (11 111 1/111 1\\ 

(22^22) (22^2-2/ W 2**2 2 2 2/ -2M22 2 -2/ 1 

;1 1 111 /l ll ll 1\ 1/1 1 111 1/1 11 1\ 

fe-2^2 2/ \2 ~2 M 2 "2// \2 ft \2 -2 2 2/ -2M2-22-2// 

= 2 Ho 1> 

If it happened that the particle in question was a spin one particle, then the matrix S z would be 

1 /<11|S Z |11> <11|5 Z |10> <11|5 Z |1-1>\ 1 n 0\ 
5 z = -ft (10|S Z |11> (10|S Z |10> (10|S Z |1-1) =-ft . 
\<1-1|S Z |11> (1-1|5 Z |10) (1-1|5 Z |1-1)/ VO 1/ 

Let me introduce two new operators and corresponding matrices built from linear combinations of S x 

1 1 

and S y . Let S+ = S x ± iS y . By inversion, S x = - (S+ + S_) and S y = — (S+ — Check it out. Add S x 

1111 
to iS y to get -S+ + -5_ + -5+ — -5_ = S+. For S+ we have 

5+ |s m s ) = hjs(s + 1) — m s (m s ± l)|sm s + 1). 
For an electron let's compute the matrix for S + . 




This jives with summing the matrices for S x and iS y . Lastly for S 2 we have 

S 2 \s m s ) = h 2 s(s + 1) \s m s ). 

Let's proceed to describing systems with more than one particle. First let's restrict ourselves to 
two particles, one with spin s x and another with spin s 2 . It turns out, as you shall see, that there are two 
bases for describing the possible spin states these two particles can be in. Let's consider the so-called 
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uncoupled basis (the tensor product basis). We know that the first particle can be in one of 2s x + 1 
states and that the second particle can be in one of 2s 2 + 1 states. If these particles are treated as 
independent, then there can be (2s x + 1) x (2s 2 + 1) possible states. This is denoted in tensor 
product notation thusly: \s 1 m Si ) (g) |s 2 m S2 ). We are effectively forming a new Hilbert space for our 
particles' spins as a product of each individual particle's original Hilbert space. What does this mean? A 
few examples should clear this up. First let's work with operators and then with matrices. For example 

if the first particle is in a spin down state and the second particle is a spin up state, then operates 
only on the first particle 



11\ 




1 


llv 






= -2 k 


-22)® 




2 2/ 







The operator only acts on the first particle's ket. Instead of working with operators, perhaps things will 
be more clear using matrices. Let 




represent the {spin up, spin up}, {spin up, spin down}, {spin down, spin up} and {spin down, spin down} 
states— our Hilbert state. Define the 4x4 matrix that only operates on the first particle's spin state as 

S z (1) = S Z ® E(2). 

11(2) is the 2x2 identity matrix that leaves the second particle's spin state invariant. That is, 
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no oo 

(1) _h (1-1(2) o-i(2)\ ft/ 1 o o 

2V0-E(2) 1-1(2)) 2 i -1 

\0 -V 



( D 

Then our example in matrix form with operating on the state with the first particle in the spin down 
state and the second particle in the spin up state is 



hi 



1 










1 










-1 








o -: 




Note that if the first particle is a spin 1 particle it could be in one of three states along the arbitrary z- 
axis, namely in states 1, 0, -1, and if the second particle is a spin 3 particle it could be in one of seven 

states: 3, 2, 1, 0, -1, -2, -3. The matrix for S^. would be an unwieldy 21 x 21 beast. The eigenvalues of 

are ^ {1,1, — 1, — 1}- The eigenvectors are the columns of the 4x4 matrix 



'1 On 

10 

10 

n0 V 



Let's stick to two spin Vi particles for now and build the remaining matrices for the tensor product 

C2") C2") (2~) 

(uncoupled) basis. What does look like? = E(l) ® . In matrix form this would look like 



(2) n C (2)N <! 00 



(2) = hl-S^ 0-S?>\ h -1 
>Z 2\o. s ™ i-sP) 2 1 



J z -"z 



-1/ 



This matrix has eigenvalues -{1, —1,1, —1} with the same eigenvectors as . Combining both 
matrices and we get 
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S z = h 



'10 





V0 -V 



The eigenvalues of S z are ft{l,0,0, —1). It has the same eigenvectors as and S z 2 \ This matrix 
operator, put together by tensor products, operates on the combined Hilbert space of the two 
electrons. What does S z do to the state with both spins up? 



h\ 



'10 





^0 -1 




The spin is 1 and it is up. What about a system with the first particle spin up and the second particle 
spin down? 

4 1 o° !)■(!)=»-(!) 

Vo o o -v W W 



The spin relative to our arbitrary z-axis is zero. Let's proceed to building the matrices for the remaining 
two axes. First, in tensor product form we have S x = S X (T) (g> 11(2). In matrix form this becomes 



/0 1 0\ 

(i) = M-n(2) 1-I(2)\ ft/ 1 

* 2U-n(2) 0-11(2)/ 2 1 

Vo i o o^ 



Then = E(l) ® S x (2) looks like 



f0 1 On 



(2) = h/l-S x (2) 0-S x (2)\ ftfi 
x 2V0-S % (2) l-S x {2)) 2 1 1 



V0 1 0' 



Lastly Sy = 5 y (l) ® 11(2) in matrix form is 
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(i) = ft/ 0-1(2) 
2 V— i 



E(2) ■ 0(2) J 









—i 
























o' 





— i 









and Sy 2 - 1 = E(l) (g) S y (2) in matrix form is 



(2) _ft/l-5 y (2) 0-S y (2)\ _ 



2V0-5 y (2) 1-S y (2) 






— i 




































— i 






Just as we could define vectors in three dimensional Euclidean space with three unit basis 

— > i ~ 

vectors i, j, k, e.g., A = 4i — 2j + - k, the spin state of particle one has three basis vectors 

d) d) d) 

S x ,Sy ,Sz . The basis vectors for the spin one particle happen to be matrices. The same applies for 



particle 2. Let's practice some of this vector algebra. S 2 = S t • S t = S x + Sy + S%. In matrix form this 



5 2 = 



h 2 

T 



'1 On 

10 

10 

V0 V 



+ 



'1 On 

10 

10 

n0 V 



+ 



'1 On 

10 

10 

NO V 



/3 On 

ft^f 3 

4 I 3 

Vo 3' 



We get the same result for Sf. We can compute the dot product S-y ■ S 2 — S lx • S 2x + S ly ■ S 2y + 5 lz 
S 2z . In matrix form this is 



^1 ' ^2 — 



h 



'10 



0-120 
4 I 2 -10/' 

1/ 



This allows us to compute S 2 = (S x + S 2 ) 2 . Note S 2 = (S x + S 2 ) 2 = Si + Sf + 2S 1 ■ S 2 . Therefore 



S 2 = ft 



/2 0\ 

2 | 1 1 

110 

n0 2^ 
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Here at last we will start to see the connection between the uncoupled (tensor) product basis and the 
direct sum basis which I have yet to introduce. The eigenvalues of S 2 are h 2 {2,2,0,2}. The 
corresponding eigenvectors are the columns of the matrix 



U = 



/l \ 

/ 1 1 \ 

— — 

V2 V2 

1 1 

— - — 

V2 V2 I 

1/ 



In terms of {spin up, spin up}, {spin up, spin down}, {spin down, spin up} and {spin down, spin down} 
states 



/0\ 



/0\ 



we have a set of "coupled" (direct sum) states (to be explained immediately following the labeling) | ^ 

Vo/ 



/On 



/On 



for the {spin up, spin up} state, and ^= \\j + ^ I a C0U P' ec ' m ' x °f tne { s P' n U P' s P' n d° wr| } state 

with the {spin down, spin up} state. We have another possible coupled mix of the {spin up, spin down} 
state with the {spin down, spin up} state 
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and we have 1^1 for the {spin down, spin down} state. The {spin up, spin up} and {spin down, spin 

down} states in the coupled (direct sum) basis are the same as before in the uncoupled basis, but not so 
the {spin up, spin down} and {spin down, spin down} states. In physics the coupled (direct sum) basis we 
have arrived at arises when the Hamiltonian includes the "spin-spin" interaction 5 X ■ S 2 . In the 
uncoupled, tensor product basis the basis vectors are 



In the coupled, direct sum basis the basis vectors are 


















1- 1 











They are connected by 
















1 































Do you see Schrbdinger's cat? When the two electrons are coupled by the dot product, two states arise 



'0\ 
1 



/0\ 




that are superposed from the pure states | „ J and . ^ ,. 



Let's formalize the coupled, direct sum basis. In this basis we emphasize the composite nature 
of a system with a particle of spin s x with 2s x + 1 possible spin states in the z-direction and s 2 with 
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2s 2 + 1 possible spin states in the z direction. If, say, spin s 2 was larger than s x then counting the 
number of states along the z-direction would tabulate like: 



S 1 + S 2 (Si - 1) + s 2 

Si + O2 - 1) (si - 1) + O2 - 1) 

Sl + (s 2 - (2s 2 - 1)) (•>! - 1) + (s 2 - (2s 2 - 1)) 
Si + O2 - 2s 2 ) ( 5l - 1) + (5 2 - 2s 2 ) 



(s 1 - 2s x ) + s 2 
( Sl - 2 Sl ) + (s 2 - 1) 

( Sl - 2 Sl ) + (5 2 - (2s 2 - 1)) 
(s x - 2s x ) + (s 2 - 2s 2 ) 



Cleaning this counting of the (2s 1 + 1) x (2s 2 + 1) states along the z axis we can get 



Sl + s 2 (s t + s 2 ) - 1 
Oi + s 2 ) - 1 (s x + s 2 ) - 2 

( 5l - S 2 ) + 1 S t ~ S 2 

Si - s 2 (s x - s 2 ) - 1 



S2-S1 

O2 - s x ) - 1 

-(S!+S 2 ) + l 

-(si + s 2 ) 



Each entry in this table represents the total spin in the z-direction for some state of our two particle 
system. But what if we didn't know about the fact that we had two particles, and we simply think of the 
table as corresponding to the spin of a system. The red entries run from s 1 + s 2 and —(s 1 + s 2 ) in steps 
of 1. Likewise the blue entries would run from s t + s 2 — 1 through—^ + s 2 — 1), and so on until we 
get to the green entries which run from s 2 — 5 X through — (s 2 — Hence we'd conclude that this 
table is a table of all possible spin states associated with spin s = {s-l + s 2 , s t + s 2 — 1, ... , \s 2 — s t |}. 

Since we do in fact know that we constructed this table by summing the z-components of the 
spin of two particles, we conclude that the Hilbert space of our two particles of spins 5 X and s 2 can also 
be constructed out of all states represented by s = {s x + s 2 ,s 1 + s 2 — 1, ... , \s 2 — % |}. Symbolically we 
write our "coupled" Hilbert space as 



Si + s 2 m Si+S2 ) © s 2 + s x - 1 m Si+S2 _ 1 ) © ... © |s 2 - s^m^^), 



where © operation is called a direct sum. 
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Now, putting it all together, the theory with our two electron example, we have 
The uncoupled Hilbert space of two electrons (two spin Vi particles) with basis 

§■ (!) ©• § 

can be transformed to the direct sum coupled Hilbert space with three symmetric states and one 
antisymmetric state. Let me explain this. Let A represent the first electron and B represent the second 
electron. In the coupled basis the first state is (spin up, spin up), or A, B. Since electrons are 
indistinguishable, I could swap labels A and B and not change anything. The second state (spin up, spin 

down) is -q= {A + B). If I swap labels I get ^=(B + A). Skipping to the fourth state, (spin down, spin 

down) we have A, B, and swapping labels doesn't change anything. For the third state something 
changes. The third state is again a combination of (spin up, spin down), but in terms of A and B it is 

1 11 

■j= (A — B). If I swap A with B, you get -^=(B — A) = —^=(A — B). This state is antisymmetric under the 

interchange of A and B while the other states are symmetric under the interchange of A and B. We have 
a triplet of symmetric states and a singlet of one antisymmetric state. In an incomplete model of physics 
can think of mesons as being composed of three spin Vi quarks and nucleons as being composed of three 
spin Vi quarks. (It's better to get the history of the strong nuclear force, mesons, and quarks from a book 
on particle physics like the one by Griffiths.) In this crude model of physics the pion spectrum (made 

from two spin Vi quarks) would be explained by - ® - = 1 © 0, and nucleons would be explained by 
-<E)-<E)- = -©-©-. We can build up these kinds of particle spectra using the matrix methods we 
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have been playing with, but there are two alternative methods as well: via ladder operators and via 
Young's tableaux. Let's mop up the matrix language for tensor products and direct sums. 

Matrix language for tensor products. Let me formalize the matrices we have formed in our 
studies of tensor product spaces. Suppose we have two 2x2 matrices A and B defined by 

A = ( Al1 Al2 ) and B = ( Bl1 Bl2 \ 

V^21 -^22/ W21 ^22/ 

The tensor product of A and B is given by 




When we computed S z in matrix form we were computing S z = S z (l)<g)E(2) + E(l)<g>S z (2). 

Direct sums of matrices in terms of matrices. If A and B are matrices of dimension m x n and 
p x q respectively, the direct sum is defined by: 

A©B = ^ n mxn ° R mX£? ) 
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where the matrix is a matrix of zeroes. Recall from our two electron example that we arrived at 

- ® - = 1 © where on the LHS (tensor product side of two spin % electrons) we had the {spin up, spin 

up}, {spin up, spin down}, {spin down, spin up} and {spin down, spin down} states given by: 



11 

22 



® 



11 

22 



11 

22 



1 1 
2~2 











1 








2 ~ 






9 











1 1 

2 ~ 2 



1 1 

2 ~ 2 



Recall also that the red states corresponded to a triplet of symmetric states, and that the sole blue state 
corresponded to an antisymmetric singlet. On the RHS, the side with 1 © it appears that we have a 
spin 1 particle coupled with a spin particle. The spin 1 particle has Hilbert space |1 m s=1 = 1), 
|1 m s=1 = 0), and |1 m s=1 = —1). The spin particle has Hilbert space |0 m s=0 = 0). From this point 
of view another assignment of the spin states makes sense. Let 



|11)=| 



|10> = 



|1-1)=| 



|0 0> = 



In this convention we list the states in decreasing order by s, and within each 5 multiplet, in descending 
order by m s . In the coupled, © basis then 



/l \ 

S z = S z>s=1 ®s z>s=0 = h 0ft(O) = ft| 

\0 -1/ 



1 





























-1 


















This matrix s z of a spin 1 particle coupled by direct sum © to a spin particle has the same eigenvectors 
and eigenvalues as the picture of two uncoupled spin Vi particles under tensor product ® with matrix 
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'10 

S = h\ 

° z I 

^0 -V 



I could align these two different pictures (two spin Yi particles under tensor product) with one spin 1 
particle and 1 spin particle under direct sum by turning the label to 



1 1\ 
2"> 



1 1 

2 ~ 2 




and 



1 1 

2 ~ 2 



11 

22 




The Hilbert space cannot distinguish if you have two spin Yt particles under direct product, or a spin 1 
particle with a spin particle under direct sum. You the physicist know this. A system consisting of a 
spin s-i particle and a spin s 2 particle, under the uncoupled tensor product representation live in a 
Hilbert space given by \sim s ) (8) |^2 m s 2 )- l n the coupled direct sum representation (using our updated 
convention for the basis states) live in a Hilbert space given by 



|*i + s 2^s 1+ s 2 ) © K + s 2 m Sl+S2 _ 1 )® ...0 



\s 2 -s x | m lS2 



-sil)- 



Since these two Hilbert spaces are equivalent, it must be that 



Km Si ) ® |s 2 m S2 ) = |si + s 2 m Si+S2 ) © \s t + s 2 ™5i+s 2 -i)© ■■■© l s 2 - ^il m| S2 _ Sl |). 



This is the addition of angular momentum in quantum mechanics. It applies to the addition of angular 
momentum for both spin and orbital angular momentum. We can equally well represent the system in 
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terms of eigenstates of the individual particle's angular momentum operators, or in terms of the 
system's total angular momentum operators. We first derived - ® - = 1 © the long way. Now that 
we have the mathematics better identified between the uncoupled and coupled bases, we have 

S 1 (8>S 2 = Si + S 2 © s l + s 2 — 1© ... ©|s 2 — SjJ, 

so 



11 3 7 5 3 1 

2®2 = 1 ® ' andsay, -02 = -0-0-0-. 



Here is a useful observation. Given this notation, note that if we replace the quantum number 
representing a state with the multiplicity of the state and change the operators ® to x and © to +, we 

should always get a correct equation. Take - ® - = 1 © for example. Each spin - state on the LHS 

-, — -J. Thus we may replace - <g) - with 2x2. On the RHS we have spin 1 with m s = 
{1,0, —1} and spin with only m s = 0. Thus on the RHS we may replace 1 © with 3 + 1. So 

11 ™ 3 f3 1 1 3") 

- - = 1 © translates to 2 x 2 = 3 + 1. The state with spin - has m s = j - , - , — - , — - j and similarly 
the state with spin 2 has m s = {2,1,0, —1, —2}. Thus there are a total of 20 basis states in -<S>2. We 

1 3 5 

know that spin - corresponds to two states. We know that spin - corresponds to 4 states. Spin - has 

{5 3 1 1 3 5") 7 
— — — -j values. There are 6 of these. Finally spin - has 8 m s possibilities. So 



3 7 5 3 1 

-02 = -0-©--©-- 
2 2 2 2 2 



translates to 4x5 = 8 + 6 + 4 + 2. This works because we're counting the total number of basis 
states in both representations of our Hilbert space. 
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How do the basis states in the uncoupled tensor product state look like in the coupled direct 
sum basis states or conversely? We're going to get to this presently, but for completeness I will also talk 
about Clebsch-Gordon coefficients and show the method of Young's tableaux. All of this material will be 
developed by example. Let's begin with a spin 1 and spin - particle. In the uncoupled tensor product 
representation the basis states are 



1 1\ 1 1\ 1 1\ 

22' Il0) ®2 2>' Il - 1) ®2 2)' 



111) (8) 



l i\ i i\ i i\ 

2-2)' |10 >® 2-2)' i 1 - 1 *® 2-2) 



1 1 



1 i\ 



13 1 

From 5 1 ®5 2 = s x + s 2 © s i + s 2 — 1© ... ©|s 2 — we know 1 (g) - = - © -. In the coupled direct sum 
space the basis vectors are 



3 3\ 


311 


---) 


2 2/' 


22/' 


2 21' 



3 3\ 
2 ~2I' 



--) 
221' 



-A 

2 21 



Let's start matching the coupled states to linear combinations of the uncoupled states using the fact 

that both representations are eigenstates of the total operator S z and the orthogonality of the basis 

3 

states in either representation. To begin, there is one state in each representation with S z = - h, 

1 3 3 \ 1 1 1\ 

namely --) = |11) ® --). This is our first linear combination with only one term on each side of the 

1 3 3\ 1 1 l\ 

equation. There is another easy one, namely - — -j = |1— 1) - — -). 
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Now we run into problems because there are two states in each representation that have 

1 1 3 3\ 1 3 l\ 

S z = -n. These are --) and --) . We will use the lowering operator (in matrix element form) with the 



negative sign 



S+ \s m s ) = hjs(s + 1) — m s (m s ± l)|sm s + 1). 



In operator form this is S_ = 5_(1) <g> E(2) + E(l) (g) S_(2). So 



33 
22 



) = (5_(1) <g> E(2) + n(l) <g> 5_(2)) |11> <g> |~| 



(§ + i) -|4 - 1) |§ = 5-CD 1(2)111) (8 |^) + KD (8 51(2) (8 Hi) 



3/3 
2 



Operator S_(l) (g) E(2) acts on the first ket; E(l) (g S_(2) operates on the second ket. Proceeding: 



2 2/ 



) = WKi + D- id -DUO) (8 |~) + Hi) (8 - 14- 1: > III) 



= ^>/2|10>®|~)+|ll>®ft|~) 



So the linear combination for S_ |~| in the (g basis is 



5_ 



3 3\ 
2 2/ 



) = = ® E(2) + E(1) ® 5 - (2)) |n) ® IM) 



N 



3 110) (8 



11' 
2Z > + 



N 



gin)® 



- 1 ) 

2 2/ 



13 l\ 

Now we seek out the linear combination of for --) by the same route— let me do the LHS algebra first. 
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5_ 



3 1\ (3/3 \ ~1 3 1\ 3 1\ 

22) = ft j2(2 + 1 )-2 ( 2- 1) 2-2/ = 2ft 2-2> = 



(5_(l)(g)I(2) + I(l)(g)5_(2))| -|10) <g> 



llv 
2 2/ + 



111)® 



2 2/ 



2ft 



--)= - ftVUi + 1) - 0(0 - i)|i-i) <g> |--| + h -Vi(i + 1) - i(i - i)|io> ® |---) 

+ft |jKH-M-0 |io) 



(8) 



1 1\ 1,1/1 \ 1 1 1 3\ 



ii) + V2jiuo>e, 



3 1 
2~2 



3 11-1)® 



11\ II 
22> + .6 |10> ® 



1 1\ |2 1 1\ 1 3\ 

ri ) + j3ll0)®---) + 0.|ll)®---) 

1 1\ fl 

2-2) + j6 |10 >® 



1 1 

2~2 



3 1\ fl llv |2 1 1\ 

2-2) = ^"^ ® Iz 2) + |10 > ® Iz- 2) 



We have found four of the coupled states in terms of linear combination of the coupled states. 

3 l\ 3 3\ 1 l\ 

We already what lowering - — -) will lead to, namely, - — -) = |1— 1) <8> ~ — We nee d to figure out 
how to compute the linear combinations for \ — It is time to use orthogonality. Suppose that 



llv 

--) = ^|10)<2) 



~) + *Ul>® 



2 21' 



268 



where A and B are to be determined. We know that 



\2 2 



1 1 

2 2 



= 0. 



(11 

\2 2 



11 

22 



N 



2 



1 1 

2 2 



+ 



N 



1 

3<"l 



i4|10>® 



11\ 

2 2/ + B|11) 



1 1 
2~2 



= 0. 



This leads to -A + -B = 0. Also orthonormality requires (-- 1 --), leading to \A\ 2 + \B\ 2 = 1. 

M 3 M 3 \2 2 | 2 2/ 



Hence A = - F and B = R Thus 



2 2/ 



) = -j3ll0>® --) + j-|ll>® ---) 



I 1 l\ 

Applying the lower operator to --) leads to 











i-i). 

2 21 


||10> (g) 


2 2/ 


||ii><8» 



2 21 



Note that the state 



i — i| is not an eigenstates of nor S^ 2 \ This state is a mixture of states 

with different values of m Si and m S2 . These results of writing coupled eigenstates in terms of linear 
combinations of uncoupled eigenstates is, of course, invertible. Seeing the uncoupled basis states as 
linear combinations of coupled eigenstates shows us that the uncoupled basis states are not eigenstates 
°f Stotai because they are mixtures of states with different values of s totai . 



Recall from above that 



S_ 



33 
22 



) = J|io>® 



---) 
2 21 
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Note that these coefficients match the table of Clebsch-Gordan coefficients from the web site 
http://en.wikipedia.org/wiki/Table of Clebsch%E2%80%93Gordan coefficients . The table is generated 



in terms of total angular momentum using the letter j instead of s. 



j 1= 1j 2 =1/2 

m=3/2 j= 



~=1-2 





3/2 


1, io| 


l| 



m-]. rri2= 



1, -1/2 



0, 1/2 



3/2 



1/2 



What we derived piece by piece follows from the Clebsch-Gordan coefficients which are solutions to 



Ji h 



IOi72)M>= ^ ^ \)im 1 j 2 m 2 ){j 1 j 2 )m 1 m 2 \j 1 j 2 )jm). 



m x =-Jx m 2 =-) 2 



Explicitly: 

O'J 2;mim 2 \hj 2 ;jm) 



(27 + l)0-+A-7 2 )!(/i+72-7))! 



Oi+72+7 + l)! 
x V0' + "0! 0' - "0! Oi + mi)! Oi + wii)! O2 + m 2 )! O2 - m 2 ) 



x 



2/c!0"i+7 2 -7 



k)\ 0i - m t - k)\ 0' 2 + m 2 - /c)! 0' ~h + ™i + W 0' "A ~ ™2 + /c)! ' 
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where the summation is extended over all integer k for which the argument above every factorial is 
nonnegative. For brevity, solutions with m < and j\ < j 2 are omitted. They may be calculated using 
the relations 

(jij2>m 1 m 2 \j 1 j 2 ;jm) = (-iy~ h ~ h (j 1 j 2 ; -™-\-™-2\kh\ ) - m) and 
(J-Ji-^m^jJ^jm) = (-I) j ~ h ~ )2 {jd2^ 1 m 2 \j 1 j2'.j'fn)- 

Let's pause to reflect a little about what we have been doing in terms of atoms with many 
electrons and in terms of quarks being constituent particles. The mathematics we have been enjoying 
so far have dealt with two spin Vi particles. We have learned that there is a triplet state of symmetric 
wave functions and a singlet state of antisymmetric wave functions. In historical nuclear physics the 
first two quarks were the up and down quark, and their antiparticles. The pions could then be described 
as members of an Isospin triplet: the n + ,n°,n~ as follows 




For the details in terms of quarks and antiquarks, please refer to chapter 12 by Melih Sener and Klaus 
Schulten in the PDF file at http://www.ks.uiuc.edu/Services/Class/PHYS480/qm PDF/chpl2.pdf . 

Systems of more than two particles. Suppose we wanted to determine the "spectrum" of states 
one can conjure up with three spin Vi electrons or three quarks, the up, down and strange quarks for 
example. We would get 
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1 1 /l 1\ 1 1/ 1 \ 

0-0-=(-0-]0-=(l©O)0- = (distribute the term- to each term on the LHS I 

/ 1\ / 1\ /3 1\ 1 3 1 1 
= ( 1 ®2)®(°®2) = (2®2)®2 = 2®2®2- 



1 3 1 

We see that three spin - particles combine to form a spin - multiplet and two distinct spin - multiplets. 

i 

The difference between the two spin - multiplets is symmetry: one of them is antisymmetric with 

i 

respect to swapping the first two spin - particles and the other symmetric with respect to that 
swapping. 



A parting example: 

1 2 3 = (1 2) 3 = (3 © 2 © 1) 3 = (3 3) © (2 3) © (1 3) 

= (6©5©4©3©2©1©0)©(5©4©3©2©1)©(4©3©2) 
= 6©5©5©4©4©4©3©3©3©2©2©2©1©1©0. 

You may have some questions about this result, such as why (3 3) counts down to 0, but (2 3) 
only goes down to 1, and why (1 3) only goes down to 2. Why? Recall that 

s 1 <8)s 2 = Si + s 2 ®s x + s 2 - 1© ...®|s 2 - sj. 

It is this result that determines that (3 3) counts down to 0, and that (2 3) only goes down to, and 
that (1 3) only goes down to 2. It's good to ask questions. 

Young's tableaux. There is nothing wrong with the parting example above, but there is a 
graphical method for converting tensor products into direct sums that also does the job of collecting 
terms into one of three bins, these being totally symmetric states, totally antisymmetric states, and 
states with mixed symmetry. This is not implicit in the method shown in the parting example above. 
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The graphical method is called the method of Young's tableaux. I follow the development of this tool 
from JJ Sakurai's book on modern quantum mechanics. All of these (SU(2) and (SU(3)) intricacies will 
generalize to a fairly straightforward set of general tools that underpin the study of Lie groups, such as, 
say SU(5,) the basis of the first Grand Unified Theory (GUT) or Lissi's Theory of Everything (TOE), E8. 

The spin state of an individual electron is to be represented by a box. We let [T] represent spin 
up and \2\ represent spin down. These boxes are the primitives of SU(2), with a single box representing 
a doublet. 



We define a symmetric tableau by 
au by Q 



(think of the spin triplet of two electrons) and an 



antisymmetric tableau by I — I , the spin singlet of two electrons. That is 



m - 



1 1 
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We don't consider |2|l| because when boxes are placed horizontally, symmetry is understood. Double 
counting is avoided if we require that the number not decrease going from the left to the right. As for 



the sing 



inglet B 



there is only one possibility: 



T 



You cannot have nor 



since there is no 



way to make these tableaux antisymmetric. To avoid double counting we do not write or 
To eliminate the unwanted symmetry states we require the number to increase as we go down. 



Now consider three electrons 
following 



We can construct totally symmetric spin states by the 





1 


1 


1 


1111= 


1 


2 


2 




1 


2 


2 




2 


2 


2 
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Each lower row has increased from the row above it. The four eigenstates are the multiplicity of the 

3 3 

j = - state. That it is symmetric can be seen for the m = - case where all three spins are aligned in the 



1 




2 


1 


or 


2 


1 




2 



positive z-direction. You can swap the order of any pair of electrons, that is, and not change the 
symmetry of the eigenstates. As for the totally antisymmetric states we may try vertical tableaux like 



but these are illegal as the numbers must increase as we go down. 

We now define a mixed symmetry tableau like EP . We may visualize such a tableau as 
either a singlet box attached to a symmetric tableau, or as a single box attached to an antisymmetric 

FP FF 

au:L_J I— I . Let's 



tableau:. 



:'s work a few examples. 



We've seen - ® - = 1 © 0. This translates to 2 x 2=3+1. In terms of Young's tableaux we have 



E 



Q ® Q = | | | ©□; 2x2 = 3 + 1 (triplet + singlet). 



What about 1 (g) - = - © -? We have 

2 2 2 



|©L_I ;3x2 = 4 + 2 (quartet+doublet). 



1 1 

Lastly consider (g) - = - . We have 



B®n=EP ; i 



x 2 = 2 (doublet). 



If the spin function for three electrons is symmetric in two of the indices, neither of them can be 
antisymmetric with respect to a third index, e.g., (|+)i|— )2 + l — M+h)! - )3 ,s symmetric with 1 «-» 2 
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but is neither symmetric wrt 1 «-> 3 or 2 «-> 3. If the number cannot decrease in the horizontal direction 



and must increase in the vertical direction, the only possibilities are 



therefore corresponds to a doublet. Notice that in this scheme we do not consider 



. The tablea 

REI 



When we were studying the relationship of two spin-- objects between the coupled and 

uncoupled representations with ladder operators or Young's tableaux above, we were really studying 
the group SU(2). The two particles could have been the z-direction spin labels of two electrons, or they 
could have been the labels up and down for the u and d quarks. We now extend our Young's tableaux 
considerations to three primitive spin-^ objects— think SU(3). The labels 1, 2 and 3 may stand for the 

magnetic quantum numbers of p-orbitals in atomic physics or charge states of the pion n + , n°, n~, or 
the u, d and 5 quarks in the SU(3) classification of elementary particles. A box can assume three 
possibilities: 



D 51 IH IH 



The dimensionality of \^\ is 3. Here is some the SU(3) Young's tableaux algebra if you will: 



Antisymmetry : 



BR R R n 
: : dimensionality 3. Note that in SU(3) we use 3* to distinguish D from | |. 



dimensionality 1 (This state is totally antisymmetrical.) 



Symmetry : 



275 



ill 


12 


13 


|2|2 2 | 3 


3 3 







1 1 1 1 1 


1 1 1 1 2 


1 1 1 1 3 


1 1 2 1 2 


1 1 2 1 3 


1 1 3 1 3 


2 1 2 1 2 


2 1 2 1 3 


2 1 3 1 3 


3 1 3 1 3 



dimensionality 10. 
Mixed symmetry : 



m Ep Ep] ran mn gpi gpi Ep] gp] 

□ : — — — — — — — — : dimensionality 8. 

Sakurai develops a general tableaux for representations of SU(3) along with a formula for the 
dimensionality of a given tableaux which is not necessary to these notes. Let's practice with a few 
problems. 



a 



_ © I — I; 3x3 = 6 + 3 (6 symmetric, 3 antisymmetric). 
Using the methods we had before Young's tableaux we would have written 

101 = 2©1© 0, 

or, changing this to ordinary products and sums: 3x3 = 5 + 3 + 1. The advantage of Young's tableaux 
is the sum 9 is broken into symmetric, mixed symmetric and antisymmetric bins— there were no mixed 
symmetry states in this example. Now let's check out: 



B®n=EP© 

methods would have 



; 3x3 = 8 + 1 (8 mixed symmetry, 1 totally antisymmetric). Our old 



101 = 2©1©O, 
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It's the same result as before (3x3 = 5 + 3 + 1) but Young's tableaux tells us more: 8 mixed 
symmetry states this time with 1 totally antisymmetric state. Let's do two more examples. 



© I I ; 6x3 = 10 + 8 (6 symmetric, 8 mixed symmetry). Lastly, 



©EP©EPe 



3x3x3 = 10 + 8 + 8 + 1. 



We can refine 10 = 7 + 3, 8 = 5 + 3, 8 = 5 + 3 in terms of angular momentum states. We have, 



y' = 3 (dimension 7) once (totally symmetric), 



y' = 2 (dimension 5) twice (both mixed symmetry), 



7 = 1 (dimension 3) three times (one totally symmetric, two mixed symmetry), 



7 = (dimension 1) (totally antisymmetric state). 



The 7 = state is unique, corresponding to the fact that the only product of vectors a, b and c invariant 
under rotation is a ■ (b x c), which is necessarily antisymmetric. (You should read Sakurai's fascinating 

3olB to an antis 



material connecting the symbc 



antisymmetric state 7 = 1 behaving like the ordinary vector 



cross product a x b = c. He also discusses how 



breaks down, noting that it must contain 



7 = 3, but that this is not the only symmetric state; a(b • c) + b(c ■ a) + c(a ■ b) is totally symmetric, 



having the transformation properties of j = 1. Evidently 
states) and 7 = 1 (three states). 



contains both the 7 = 3 (seven 
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Optional diversion on color. This is the last and optional material from Sakurai before getting to 
the optional Wigner-Eckert theorem and the material on weight and root diagrams and Dynkin 



diagrams. The SU(3) decuplet corresponds to | = (10) 



3 

A ++ , A + , A , A -1 ddd, udd, uud, uuu I = - 



dds,uds,uus 1 = 1 



n - 1 

E , H dss uss I = - 



fl sss 7 = 0. 




q=-\ 



3 

All of these ten states are known to be spin - objects. It's safe to assume (Sakurai's words) that the 
space part is in a relative S-state for low lying states of three quarks. We expect total symmetry in the 

3 3 

spin degree of freedom. For example, the j = - m = - state of A can be visualized to have quark spins 

i 

all aligned, BUT the quarks are spin - particles subject to Fermi-Dirac statistics. Yet with 



Quark label (now called flavor): symmetric 
Spin: symmetric 
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Space: symmetric 



3 

for the j = -decuplet. The total symmetry is even— the historical "statistics paradox"! The way out of 
this was to postulate that there is an additional degree of freedom called color (red, blue or yellow) and 

3 + 

postulate that the observed hadrons (the strongly interacting particles including the / = - states 



considered here are color singlets 



1 

— (\RBY) - \BRY) + \BYR) - \YBR) + \YRB - \RYB). 
V6 



This is in complete analogy with the unique I — I totally antisymmetric combination in color space. The 
statistics problem is now solved because 



p _ n(flavor) p(spin) p(space) p(color) 
r ij ~ r ij r ij r ij r ij 



(-) = (+)(+)(+)(-)■ 

This "cheap" solution in fact comes with measurable consequences such as the decay rate of the n° and 
the cross section for electron-positron annihilation into hadrons. End of optional Sakurai based SU(3) 
particle physics material. 

(Optional) Wigner-Eckert theorem on selection rules. In quantum mechanics we typically have 
to evaluate quantities of the nature (i/;|j4|0) where A is some operator and if) and are eigenstates of 
an unperturbed Hamiltonian H which is invariant under some symmetry; for now consider invariance 
under SO(3). 

Scalar case . Let X be an angular momentum operator (spin or angular momentum) with 
components X 1 ,X 2 ,X 3 (we may see X as a vector thusly) and let S be a scalar operator. Then 
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[X, S] = 0, or equivalently wrt SO(3) rotations U(R), UiR)SU(R)- 1 = S. (Weight and length, for 
example, are invariant under rotations.) From the commutator we may extract selection rules that 
Unless j = ]' and m = m', (j'm'\S\jm) = 0. Moreover, this matrix element is independent of m, so 
that (j'm'\S\jm) = NjSjj'S mm i (no summation). Let's show these conclusion more explicitly. 

The condition j = j' is a consequence of the vanishing of the commutator [S, X 2 ]. Let me 
explain. Consider 

0'm'|SX 2 |ym> = j(j + l){j'm'\S\jm). 
But since S is just a scalar (a number), SX 2 = X 2 5. So 

(y'm'|X 2 S|ym> = + l)(j'm'\S\jm). 
It must also be that {j'm'\SX 2 \jm) = {j'm'\\ 2 S\jm) so 

j(j + \){j'm'\S\jm) =)'{]' + l)(j'm'\S\jm). 

Equivalently 

(J-j')(j+J' + l){j'm'\S\jm) = 0. 

Certainly (j + j' + 1) is positive. So either j = j' or (j'm'\S\jm) is zero. Now for showing that m = m'. 
This follows from [S,X 3 ] = 0. That is, (SX 3 - X 3 S)Tp = S(X 3 - X 3 )Tp = 0. Lastly, (j'm'\S\jm) depends 
only on j and not on m. This is a consequence of the vanishing of [S,X+]xIj. Consider 

(jm\S\jm) = (j'm'\SX+\jm) = (j'm'\X+S\jm). 

Then 

70 - m + 1)0 + m)(Jm\S\jm) = (jm\SX + \jm — 1) 
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and, recalling that = X_, 

(jm\SX + \jm — 1) = (jm\X + S\jm — 1) = j(j — m + + m)(jm — l|S|y'm — 1). 

This is the Wigner-Eckert theorem for scalars. QED. 

Vector case . Before getting to the theorem, let's build up our understanding of vector 
operators. Suppose there is an observable V that is a vector. That is, its three components V x , V y , V z in 
an orthonormal frame satisfy 

\J X .V X ]=0, [j X ,Vy] = ihV z , [j x ,Vy] = -ihVy (A) 

as well as those obtained by cyclic permutations of the indexes x,y and z. See complement B V i of 
"Quantum Mechanics, Volume Two", Claude Cohen-Tannoudji, Bernard Diu and Franck Lalbe. (The 
material of the vector case is from complement D x .) To give an idea of what these above commutators 
mean, let's study some examples of vector operators. 

The angular momentum J is itself a vector. If we let V be J the above commutators become the 
usual angular momentum commutation relations, e.g., \] x ,]y\ = ihj z . On the other hand, if we let J be 
L (orbital angular momentum) and V be R a radius vector, then the relations (A) become 

[L X ,X] = [YP z -zP y ,X] = 0, 

[L x , Y] = [YP Z - zP y , Y] = [-ZP y , Y] = ihZ, 

[L X ,Z] = [YP z -zP y ,Z] = [YP Z ,Z] = -ihY. 

For a particle of spin S, J is given by J = L + S. In this case the operators L, S, R, P are vectors. If we 
take into account the fact that all the spin operators (which act only on the spin state space) commute 
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with the orbital operators (which act only in the R = {X, Y,Z} state space), the proof of the commutator 
relations (A) follows from our first two examples. On the other hand, operators of the type L 2 , (L ■ S), 
etc., are not vectors, but scalars. Other vector operators could, however, be constructed from these 
scalars, e.g., R x X and (L ■ S)P, etc. 

Consider the system (1) + (2) formed by the union of two systems: (1), of state space £ 1 . And 
(2), of spates space £ 2 . If V(l) is an operator which acts only in £ x , and if this vector (that is, satisfies 
(A) with angular momentum vector J x , of the first system), then the extension of V(l) into state space 
£i ® £2 is also a vector. (This tensor product stuff is what we have been doing.) For example, for a 
two-electron system, the operators L x , R 1( S 2 , etc. are vectors. 

Wigner-Eckert theorem for vectors . We introduce the operators V + ,V_,J + ,J_ defined by 

V ± =V X ± iVy 

J+=J X ± Uy 

Using relations (A) we can show that: 

\J x ,V ± ] = +hV Z: 

Let's check this. 

Ux, V ± ] = [j x , V x ± iV y ] = \Jx, V x ] ± i[j x , V y ] = 0±i- ihV z = +V Z . 

Similarly, 

[j y ,V ± ] = -ihV z , 

UM = ±hv+. 



Once we have verified the above commutation relations, we can show 

U + ,v + ] = o, 

\J + ,V_] = 2hV z , 
\J-,V + ] = -2hV z , 

U-,V-] = o. 

This kind of algebra, by the way, is the kind of algebra that underlies root and weight diagrams and 
Dynkin diagrams that underlie the Standard Model and extensions beyond it using larger Lie groups, 
e.g., SU(5) GUT and Lissi E8, which are defunct, but very instructive. 

Let's show that (jm\V+\j ' m') = whenever m m'. To show this it suffices to note that V z 
and ] z commute (you can prove this to yourself). Therefore the matrix elements of V z between two 
vectors \jm) corresponding to two different eigenvalues of mh of ] z are zero. 

For the matrix elements (jm\V+\j'm') of V+ we shall show that they are different from zero only if 
m — m' = ±1. The equation \J Z , V+] = ±hV+ indicates that: 

J Z V ± = V ± J Z ± hV ± . 

Applying both sides of this relation to the ket \j'm') we obtain 

J z (y ± )\j'm') = V ± J z \j'm') ± hV ± \j'm') = (m' ± l)hV ± \j'm'). 

Evidently V+\j'm') is an eigenvector of J z with eigenvalues (m' ± l)h. Since two eigenvectors of a the 
Hermitian operator J z associated with different eigenvalues are orthogonal, it follows that the scalar 
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product (jm\V+\j'm') is zero if m m! ± 1. Summing up, the selection rules obtained for the matrix 
elements of V are as follows: 

V z => Am = m — m! = 0, 

V + = Am = m — m' = +1, 

V_ = Am = m — m! = — 1. 

QED. The matrix associated with is diagonal and those associated with V+ have matrix elements only 
just above and just below the principal diagonal. 

A similar procedure can be adopted to find the selection rules for a tensor operator, T. 
However the procedure rapidly becomes cumbersome and a more powerful method is required, namely 
the Wigner-Eckert theorem (see H F Jones, "Groups, Representation and Physics," 2 nd . Ed. An 
irreducible tensor operator 7^ is an operator that transforms under rotations according to 

UWTlUiR)- 1 = D ] mm ,{R)\im). 

(Tensor operators may have more indices .) Stating the result, the Wigner-Eckert theorem states that 

{jm\Ti\j'm') = CQj'j;Mm'm){j\\V\\j'). 

The CQj'j; Mm'm) are our Clebsch-Gordan coefficients. 

Root and Weight diagrams and Dynkin diagrams. Before the theory, let's begin with an 
example that will make the theory transparent. In quantum physics we seek to discover the largest 
possible set of commuting hermitian generators because we want to diagonalize as much as 

possible. Such a largest possible subset is called the Cartan subalgebra. 
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Example 1— Consider the eight Gell-Mann matrices from Part I, the defining representation of SU(3). 

/0 1 0\ /0 -i 0\ /l 0\ 

^=100, h = [i , A 3 = -1 0, 
VO 0/ VO 0/ VO 0/ 

/0 1\ /0 -i\ /0 0\ 

A 4 = , A 5 = , A 6 = 1, 
Vl 0/ \i 0/ VO 1 0/ 

/0 o \ 1 /ioo\ 

A 7 = -i J, A 8 =— 1 . 
Vo i 0/ V3 \0 -2/ 

These matrices are hermitian (Aj = At) and traceless. For the Gell-Mann matrices, the Cartan subalgebra is 
easy to pick out: A 3 and A 8 are the only diagonal matrices, and hence they commute: [A 3 , A 8 ] = 0. Therefore we 
would say in quantum physics that A 3 ,A 8 have simultaneously measurable eigenvalues. The dimension of the 
Cartan subalgebra (being 2) is called the rank of SU(3). 

Let's consider the commutator algebra [Aj,A ; ]. Find the commutator of the first two matrices: 

-i 0\ /0 -i 0\ /0 1 0\ /l 
Ol-lt Olll 0l = 2il0 -1 

o o/ V o q' Vo o q' V o o 

You can check for yourself that [A 2 , AJ = —2iA 3 . Ingeneral, = -fijk^k> where the repeated index implies 

summation from k = 1,2, ... ,8, and the f t j k are the structure constants. For the Gell-Mann matrices, (dividing the 
matrices by 1/V27) we have 

_V3 

/l23 — 1. /458 — /678 ~ /l77 ~ /l65 ~ /246 ~ /257 ~ /345 ~ /376 ~ 1/2- 

Any fij k involving an k permutation not on this list is zero. Even permutations, e.g., 123 -> 312 -> 213 have 
the same value. The odd permutations (123 -> 132) have the opposite sign. So f 123 = f 312 = /231 = -1 and 
/132 = /321 = /213 = — 1- The symbol / t;fc is said to be totally antisymmetric in i.j.k. 





1 









:)( 


Vo 
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Example 2— Consider 



U^s] - 2i/ 45a A a - 2i[f 453 A 3 + / 458 A 8 ] - 2t 



V3 



/l ON 
2t 
VO -1/ 



We could have gone the long way to obtain this result by computing the matrices directly in — A B A 4 . Georgi's 

i 

text uses T a — -A a . Let's use this T" relabeling. The eigenvectors of T 3 and T 8 are 



•)■ (! 



with eigenvalues, respectively, of -, — - and for T 3 and — ,— , — — . They plot like: 

2 2 6 6 3 



■*8 



(-l/2,l/2V3)d 



(l/2,l/2V3)u 




(0,-1 /V3)s 

This graph (weight diagram) should remind you of how the up, down, and strange quarks fill a graph of 
hypercharge versus the third component of Isospin T 3 . The Gell-Mann matrices are a particular 
representation of SU (3), the special unitary matrices with determinant +1. Finally note that the Gell- 
Mann matrices are a generalization of the Pauli spin matrices in the sense that the first three Gell-Mann 

atrices contain the Pauli matrices acting on a subspace A a = ^ , a = 1,2,3. 



m 



The root diagram is easy to construct from the weight diagram. Let A = ~ i, ^j=fj , B = 

Q^>^f/)>C = [pi, — J|/J- Start taking differences of these vectors. A — B = (— It, 0y), A — C = 

(-^,fy), B-C = (^f;),B-A=(U0/),C-A = (^,-f/), C - B = (-^,-f /). We 
can also get the vector three different ways. The following figure is our root diagram. 
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(0 



(2^2 ) 



This is reminiscent of ® = 



©I — I; 3x3 = 6 + 3 (6 symmetric, 3 antisymmetric). In 
fact, the two previous figures lead to a graphical representation of SU(3). In terms of the superposition 
of the previous two drawings (three quarks for the weight diagram superposed with the meson nonet): 







/ i y 




/ V\" 




ATX— 














/ \ 7 




' \ / 


\ / 1 













The dimension of SU(3) is the rank of the Cartan subalgebra, namely 2, plus the number of root vectors 
extending from the origin, namely 6. That is dim SU(3) = 2 + 6 = 3 2 — 1. Note quickly that when we 
only had the SU(2) up and down quarks we could have built a graphical representation of SU(2) thusly: 



(V 

¥ =- V 

* 



i => 
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See: http://theory.gsi.de/~friman/e-part-script/EPP ll.pdf . 

We may get the same diagramatic weigth and root results in terms of ladder operators (raising 
and lower operators). This is a more official way. Consider 

where T 3 belongs to the Cartan subalgebra and E a is a raising or lowering operator. Let's make this 
explicit. Using Georgi's matrix notation for the Gell-Mann matrices we have: 



1 /Q 1 ON 
7i=- 1 

\o o 0/ 



1 /0 -i ON 
T 2 =- [i 
\0 Oy 



'1 ON 



'0 In 



t 3 = - o -l o , r 4 = - o o o , 



vO 0/ 



vl 0/ 



1 /0 -jN 
T 5 =- 
\i 0/ 



'0 ON 



'0 



r 6 = - o o i , r 7 = - o o -i , r 8 = 



v0 1 0/ 



v0 i 



2V3 



a o on 

10 

vO -2/ 



Now we build our raising and lowering operators E a and E„ for S[/ (3) as follows. Let: 





"0 


1 


0" 






"0 





0" 


T x + iT 2 = 











, T t 


-iT 2 = 


1 










.0 





0. 






.0 





0. 




"0 





1" 












0" 


T 4 + iT 5 = 











• 7*4 


-iT 5 = 













.0 





0. 






.1 





0. 




"0 





0" 






"0 








T b + iT 7 = 








1 




-iT 7 = 













.0 





0. 






.0 


1 


0. 



Now let: E +1 = -= (T 1 ± T 2 ), and E . ^ = -= (T 4 ± T 5 ), etc. Let's see what this mess we've made 

— ' V2 +-,+ — V2 

— 2 2 

does for us. (You'll soon see that these operators move us around the figure above which is reminiscent 
of the pseudoscalar meson nonet.) 
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[7-3,7-1 + iT 2 ] = [T 3 ,E a ] = [T 3 ,E +li0 ] = 



2 

0J 



= 7\ + iT 2 = 1 ■ E + 



1,0- 



So the eigenvalue is a = 1. Consider [T 8 , r x + iT 2 ] = [78#£+i,o] = ■ (T x + iT 2 ) = ■ /j + i ;0 ; •'• a = 
for this case. So we get the point (1,0) of our meson nonet. Let's try a few more. 

[7- 3 , T r - iT 2 ] = -(7\ - iT 2 ), .: a = -1, [7- 8 , T r - iT 2 ] = ■ (T x - iT 2 ), .: a = 0. 

Now we have the point (—1,0) of our nonet. Let's proceed to: 



1 V3 V3 
[T 3 ,T 4 + iT 5 ] = (T 4 + iT 5 ),.: a = -, [T 8 ,T 4 + iT 5 ] = — (T 4 + iT 5 ),.: a = — 



and finally, 

[7-3,7-3] = [7-3,7-3] = [7-3,7-3] = 0, 

the three points at the origin. Doing all the cases gives us our complete nonet root diagram. Let me just 
say that the Killing form is used to transform the Cartan subalgebra into an orthonormal basis. We'll get 
to that in a moment, but first let me show you yet one other way to build our nonet via the adjoint 
representation of SU(3). 

The adjoint representation of SU(3). The structure constants themselves generate a 
representation of the algebra called the adjoint representation. That is, we may define a set of 8 x 8 
matrices [T a ] bc = —ifabc 3 [T a > 7&] = ifabc J ust as tne Gell-Mann matrices do. 



Example 3— Let's see. 
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^876 
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The matrices in the adjoin representation are 7 x 7 since f 8ab with either a of b = 8 give zero. The 
eigenvectors for T 3 with eigenvalues as subscripts are: 








- - 




- - 




- - 




- - 




-V2i" 




"-V2Y 



























-V2 




V2 


1 





































— V2i 




— V2i 
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-V2 




V2 





































V2i 




V2i 



























-V2 




V2 












-0- 





- - 


1 

9 


- - 


1 

9 


L J 


3 
9 


L J 


3 
9 


- - 


-1 


- - 



For T 8 we have: 



290 








r fl i 




r fl n 




r fl n 




r fl n 
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n 




n 




n 




U 




1 


1 








n 




n 




n 




U 




U 







-V2i 




-V2t 
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-V2 
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V2 


} 















} 




















Vli 




-V2t 



























-V2 




-V2 












-0- 





- - 




- - 


V3 


L J 


V3 


L o J 


V3 








-0- 



2 2 2 2 



The first three eigenvectors for T 3 and T 8 are simultaneous. So too are the next two because they differ 
only by the factor -1 and this doesn't matter (when you're squaring things). The last two eigenvalues of 
T 8 do not appear (at first glance) to be simultaneous eigenvectors with the last two eigenvectors of T 3 . 
Notice, however, that the last eigenvectors of T 8 have the same eigenvalue, namely 0. As you learn in 
quantum physics, we may proceed to break this degeneracy by a change of basis. Consider the 
subspace of 

* (-! I) 

with normalized eigenvectors 







V2 


V2 


1 ' 


1 


Vvf/ 


V Ti ) 



We may form a unitary matrix U such that UU^ = E 2 x2- That is: 




Then 

^ ( ^1 o) ^ = ( 0^ ?) = ^ a S ona l matI "i x - 
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The eigenvectors with eigenvalues as subscripts are 



In this basis, the subspace of T 3 has simultaneous eigenvectors with T 8 . If we plot these eigenvalues of 
T 3 against T 8 as coordinate pairs we again get our nonet: 



The eigenvalues in the adjoint representation are named roots. 

The Cartan subalgebra for SU(3) was of rank 2. The roots and weights can be plotted on plane. 
The roots and weights of other, larger Lie algebras require three, four, or many more dimensions to plot. 
The first grand unified theory (1974) (a unified theory of our known forces excluding gravitation) was 
based on SU(5), the Standard Model being a subgroup of this larger Lie group. People tried to find a 
larger group (SU(5)) than contained the Standard Model groups. This embedding led to new vertices in 
the Feynman rules corresponding to a more general, unified Lagrangian. The group theory tells you 
about what transforms to what under interaction, but does not say very much about the actual 
functional form of the potentials. In this vein in 2007, Lissi published a Theory of Everything, a theory 
which includes gravitation, based on the exceptional Lie group E8. Many tools have been developed to 
the study of the four infinite Lie algebras as well as the five exceptional Lie algebras. Among these tools 
are Dynkin diagrams introduced in 1947 by Eugene Dynkin. A Dynkin diagram records the configuration 
of a Lie algebra's simple roots. I have given you what you need to read the readable work of Wangberg 
and Dray in "Visualizing Lie Subalgebras Using Root and Weight Diagrams," A Wangberg and T Dray, 





(-1*0) 




(1.0) 
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Department of Mathematics, Oregon State University, Corvallis, Oregon 97331, 15 March 2008. You 
may find this brief but explicit article at: 

http://www.math.oregonstate.edu/~tevian/JOMA/ioma paper softlinks.pdf . This material is brought 
to life by the authors at http://www.math.oregonstate.edu/~tevian/JOMA/joma paper three.html . 
You can see the plotting being done by JAVA script. These authors show you how to build Dynkin 
diagrams, and how to use them to help you study subalgebras. I have pitched my copy of Georgi in the 
trash, something I should have done years ago. H F Jones is now far more readable. This concludes the 
"Lie" program tying differential equations (ordinary and partial, linear and nonlinear) with algebra and 
global and local topology with physics. 
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Part V.I Fractional calculus . Differentiation and integration can be generalized beyond 
integrating and differentiating in integer steps, e.g., 1 st derivative, 2 nd derivative, and so on. I 
recommend "The Fractional Calculus, Theory and Applications of Differentiation and Integration to 
Arbitrary Order," K. B. Oldham and J. Spanier, Dover, 1974. It is far more general and applied and full of 
centuries of history than a website I found on this subject. Nevertheless, the notes I made from the 
website provide a good beginning to Oldham and Spanier. 

d n 

Consider f(x) = e ax . If you take n derivatives you get: j~^f( x ) = a n e ax . (We'll soon see 
that if n is a negative integer, this leads to integrations.) So why don't we replace n with v where v is 
not necessarily a positive integer? Then, — = a v e vx . In fact any function that is expressible as a linear 
combination of exponential functions can be differentiated likewise: 

{i) v e ix + {-i) v e- ix 



d v d v 



;COSX = 



dx v dx v 



Since (±i) n = e _ ~2~, 



d V ( V1T\ 

;COSX = COS ( X + —J . 



dx v V 2 

The differential operator shifted the phase of the cosine function (ditto the sine function). 

Now consider that a very large class of functions have Fourier representations: 

-J^ ^ CO -J^ ^ CO 

f(x) = —= I g(a)e~ mx da, where g(cc) = —= I f(x)e mx dx. 
\2n J-oo \2n J-oo 

Here / and g are Fourier transforms of each other. Then differentiating f(x) by d v /dx v results in 
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d v 
dx 



-f{x) = -±= \ g{a){-iaYe- iax da. 



Evidently the Fourier transform of the generalized n th of /(x) is (— ia) v g(a). This approach to the 
fractional calculus has pathologies. With this approach, how do we determine the half-derivative of 
fix) = x? There is no Fourier representation for this open-ended function. We could chose a finite 
interval, but which one? Let's turn back to the definition of differentiation. 

d ... f{x) -f{x -e) 

— fix) = hm . 

dx e->o e 

Repeat once to get: 

fjx)-fjx-e) ( fjx-e)-fjx-2e) \ 

d 2 e { e J ,. /(x)-2/(x-e)+/(x-2e) 
——. r = hm = hm ^ . 

ax / e->o e e->o e z 

Repeat again to get: 

fix) - f{x -e)- 2 fjx - e) + 2fjx - 2e) + fjx - 2e) - fjx - 3c) 
d ,2 

= lim ^ 



dx 3 e->0 6 

fix) - 3 fix -e) + 3 fix - 2e) - fix - 3e) 



= lim- 

e->0 6 



3 



Repeating n times yields 



(1) 



dx 

j = 



Indeed if fix) = x 4 (dropping all powers of e 2 or higher): 



d 2 

rx 4 = lim[x 4 - 2(x - e) 4 + (x - 2e) 4 ] = lim[12x 2 - 24xe + 14e 2 ] = 12x 2 . 



dx 2 (->() v e->0 
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We generalize (1) for non-integer orders, generalizing the binomial coefficients and determining 
the generalization of the upper summation limit. Consider a smooth function f(x) as shown below: 








x— 5e x — 4 e x— 3e x— 2s x—s 



Note that x = ke = Se. Define the shift operator o e f(x) = f(x — e). Consider an operator D 



D n [f(x)] = lun(— ^) f(x) 
<?->o \ e / 



What isDVOO? 



D x f(x) = lim (- — —)f(x) = lim 
e->o \ e I e-»0 



f {x)-fjx-e) \ d 
e =^ /(x) " 



What isD _1 /"0) ? 



/l - o,\ 1 1 

D^fix) = lim - f{x) = lim f(x) 

<?->o \ e / e^o e 1 — ov 



1 1 



Recall that — = 1 + z + z 2 + z 3 + Then (with e = ) 

i-z 1 N-r 



D^fix) = lime(l + a e + a 2 + -)f(x) = lime(/(x) + f{x - e) + /(x - 2e) + - + /(0)) 



e->0 




w-i x 

= lim 7 / (x — A:e)e = — I f(x)dx = I f(x)dx. 

fe=0 * u 



"Differentiating" to -1 order is integrating once! 
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Regarding equation (1), if n is a positive integer, all of the binomial coefficients after the first 
n + 1 are zero (C(n; j) = V j > n. For negative or fractional values of n the binomial coefficients 
are non-terminating. We must sum over the specified range. The upper limit should be yielding: 



(la) 

\(x-x)\ 



dx 

7=0 



What do we do about y J = — — - when n is not an integer? Enter the gamma function. For integers 

\ru j'Xn-jy. 

T(n) = (n- 1)!. 

It is a consequence of the general gamma function for complex-valued arguments, which is 

r(z) = e-H'^dt. 



Most special functions of applied mathematics arise as solutions to differential equations. Not so the 
gamma function— at least not yet (Holder's theorem). From the following integral 

f +1 , (2n+l)!(n!) 2 \(2n + l)\ f +1 " 

j ^ (l-x 2 rdx = y 2 J +I y , we get, n! = \ 2n+1 J ^ {1-x^dx. 

Thanks to the (2n + 1) argument, we have generalized the definition of the factorial to negative and/or 

positive half-integers, e.g., (— ! = t/tT. But we have actually done better than this. Now that the 

factorial of all half-integers is defined, we can compute the factorial of quarter-integers, sixteenth 
integers,.. .,so that, using the binary representation of real numbers, and using the identity the 
(x + 1)! = (x + l)x!, we actually have a well-defined factorial function for any real number, otherwise 
known as the gamma function: T(n) = (n — 1)! V n > 0. The recurrence relationship is T(x + 1) = 
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xr(x). The reflection relation is r(x)T(l — x) = p/ sin(px). One could write volumes on the gamma 
function. Now we can generalize (la) to 

(2) 

d v i v> . r(v + i) 

7=0 

Ordinary differentiation is local, integration is not local, nor is our generalized definition of 
differentiation/integration (2) (See Oldham and Spanier). If n is integer-valued, the binomial coefficients 
for all j vanish past j = n, and in the limit as e goes to zero the n values of f(x — ke) with nonzero 
coefficients converge on x, keeping the generalized operator local. In general, however, the binomial 
expansion has infinitely many non-zero coefficients, so the result depends on the value of x all the way 
down to x . (Look up Huygens' Principle and the sharp propagation of light in three dimensions.) 
Choosing x = 0, equation (2) becomes 

(3) 

l~l 

d v if . r(v + 1) 

7=0 

Let's go for a test drive with /(x) = x and n = 1/2. 



i 

d.2 
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where the factorials are in terms of the gamma function. Recall that we used I — i ) . With n = 



/l-o-A 1/2 1 r 1/1 1 \ 



Then really have: 



x 2 — a e x 2 



d l . 

— -rx = lim —=J1 — a e x = lim 

dx2 '^'^ ^ Uf 



= lim 



x 2 — (x — 2e) 2 \x 2 — x 2 + Axe — 4e 2 
— = lim 

ne e^oo ne 



\\xe - 4e 2 , 

= lim I = 2-sJx/n. 



e-»°°J ne 



That is, 



i 

d.2 Vx 

x = 2 -■ 
in 



l 

dx2 



(4) 



If we play around a bit with regular calculus we observe the pattern — -x m = - — — x m n . In our 

v ' b v dx n (m-n)! 

generalized framework we have 



d v 



(5) 



m _ 



ml 



dx v r(m + 1 - v ) ' 



Then, paradoxically, using equation (5), the half derivative of a constant c is: 



d2 0! _ c 

-c = c — —\x = 
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We have to be careful and think about local versus nonlocal behavior. Equation (5) gives no hint on non- 
locality, as opposed to equation (3) which depends on what x is doing locally. This issue is cleared up by 
considering the half derivative of the exponential function e ax . Using equation (5) we get 



i i 

v d.2 / 1 \ 1/ 4, 16, \ 



dx2 dx2 

Wouldn't we have expected this derivative of the exponential function to equal itself? A plot of the 
above series versus e x shows that the two graphs converge asymptotically at large x. However near the 
origin, the series blows up whereas e x passes smoothly through x = 0. Consider the integrals 



f x , x 4 x 4 f x 

u i du = — — , e u du = e x — e x ° . 

k 4 4 k 



.X 4 



The left hand integral shows that when we say x 5 is the derivative of — we are implicitly assuming 

4 

x = 0. This is consistent with our derivation of (3). HOWEVER, when we say that e x is the derivative of 
e x we are saying that x = -co so thate* = 0. Thus for each of the two above integrals/derivatives we 
have tacitly assumed different ranges. The fix is to go back to equation (2) and replace x = with 
x = —oo. Now we're cooking: 



d v 



OO 

iv rfv + 1) 

, v /(*) = lim — > (-D' V. = ~ fix-je). 
dx v e^oe v Z_i i!r(v+l-]J 



One point of this section is to out the glaring omission of calculus with other than integer order 
differentiation and integration, it can be real-value-ordered, even complex-value-ordered. There are 
also strong applications of fractional calculus to the problems of transport and diffusion processes such 
as neutron migration and flow through porous materials. Talking about diffusion processes... 
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Part V.ll Stochastic differential equations (SDEs), random walks and the ltd calculus . My goal 
here is to prove a theorem concerning quadratic variation. Why? For practical ends I assure you. How 
does one integrate a function in which some of the terms are stochastic? In difference form consider 



where AW = iV(0,l), the normal distribution with mean and standard deviation 1. We start at 
x = 0, t = and head to t fina iending up at some unknown value of x. What would be our 
"expectation" of x? (What is the mean of x? What is the standard deviation of x? The physicists 
answered this question employing Monte Carlo methods requiring computers. With a computer we 
throw a dart, so-to-speak and pick a number between and 1 according to N(0,1) (or some other 
distribution). We advance x and repeat, generating a path until we arrive at t final . The we start the 
process from scratch, repeating it many times over so that we obtain a numerical estimate of the mean 
and standard deviation of x. The mathematicians did things nice and proper in a measure-theoretic 
framework. Is there a middle ground? Yes. The material presented below. Along the way we will see 
applications to diffusion and high finance. 

On quadratic variation (this first portion excerpted from the Feynman lectures). Let D N be the 
net distance traveled in N steps (each with time t and speed v ) of a drunken sailor in one-dimension. 
Then, (with expectations, or means in brackets), 



Ax = a(x, t)At + b{x, t)AW, 



D to = v t = I, 





If the sailor steps to the right, then we have 



D Nt ~ D (N-l)t + I 



D Nt ~ D (N-l)t + 2D (N-l)t + V 



If the sailor steps to the left (with equal probability) then we have 
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(Af-l)to 



- 2D( W _ 1)to + Zg. 



The sum D^ to (right) + D^ to (left) is then 




2Dl 



(Af-l)to 



= 2Z) + 2Z^. 



(The twos can be removed.) Since (Dt ) = Zq, 



^! t0 ) = (^ 2 ) + ^ = 2Z 2 , 



(Dl to ) = (Dl tQ ) + l 2 = 3l 2 



(D 2 Nto ) = Nil 



This expresses the variance. The root-mean-square (rms) (or standard deviation) distance is thus 

Note that Nt is the total walking time, T. If we set t = Is, v = 1 m/s then Z = lm. Thus 

D rms = Vf [m]. 

The standard deviation of the distance (in meters) after N steps is proportional to the square root of the 
time— the key idea to quadratic variation. Note— The universal character of Brownian motion is simply 
the dynamic counterpart (evolution in time) of the universal nature of its static counterpart, the normal 
or Gaussian distribution. Both arise from the same source, the central limit theorem. This theorem 
states that when we average large numbers of independent and comparable objects, we obtain the 
normal distribution. That is, what we observe is the result of a very large number of individually very 
small influences. Note that 2D Nto = 2D( Af _ 1 ) to + Z — Z . Thus (D NtQ ) = (£>(jv-i)t ) (induction) 
(D t ) = 'o- 0n average the sailor goes nowhere, his standard deviation goes like Vt[m]. 
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Necessary review of probability theory. Let's start by reviewing moments. If f(x) is a 

probability density function (density or distribution) the first moment about the origin (the center of 



mass is 



/. oo 

\i x = E[x] = I f(x)dx. 

J — oo 



The first moment about [i x is E[x — E{x)] = 0. The second moment (the VARIANCE) about the mean is 
E[(x - pi) 2 ] = E[x 2 - 2xfi + pi 1 ] = E[x 2 - 2fi 2 + [i 2 ] = E[x 2 - pi 2 ] = E[x 2 - (E[x]) 2 ] = a 2 . The r th 
moment about the mean is defined by 

/. oo 

Hr = E[(x- p) r ] = (x - n) r f(x)dx. 

J — oo 

Naturally, the r th the moment about the origin is £"[x r ]. In general Var[x r ] = E[x 2r — (E[x r ]) 2 ]. 

The Moment Generating Function (MGF). Let X be a random variable. The MGF of X is 

M x (t) = E[e tx ] at all values of t for which the expected value exists. In integral form, 

r. OO 

M x (t) = e tx f{x)dx. 

J — oo 

Example 1— Let our density be 

f(x) = \e~ x , x > 
( 0, otherwise 

M x {t) = j 



OO -J^ 

e tx e~ x dx = . 

1-t 



Theorem (no proof)— The r th derivative of the MGF obeys M x r) (0) = J™ m x r f(x)dr = E[x r ]. NOTE : 
the expectation E[x r ] are taken with t = in M x (t). 
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Example2— For example 1: M x \t) = _'"'_ r _ 1 , so M x \o) = r! = £"[x r ]. This gives our mean and 

variance. The mean is \i = Elx 1 ] = M^\o) = 1! = 1. The variance is Var(x) = £(x 2 ) — [i 2 = 
M x 2) (0) - 1 = 2! - 1 = 1. 



Now we will denote the MGF by: 

r. OO 

M x (t) = E[e tx ] = e tx dF(x). 

J — 00 

Note that if X and Y are independent random variables, M x+Y = M x (t) ■ M Y (t). Think convolution. 



t k 

M x (t) = E[e tx ] = 1 + tE[x] + ■■■ + -T7E[x k ] + e(t), 

where e(t) denotes the round off error. As before M x k \t) = E[x k ] for the k th derivative. Consider 

i -- 2 

iV(0,l) = f{x) = -j^e 2 * , (A) a normal density with mean and standard deviation 1. Let x' = [i + 



ox, then we have N(fi, a) being defined by 



V-f) 2 



1 _I 

fCx') = —=e ° 2 



( Drop the primes .) Getting back to the MGF for N(fi = 0, a = 1), 

r< CO -J^ r. CO 

M x {t) = e tx N(0,l)dx = -— e tz "2 z2 dx. 
Completing the square: tx — -x 2 = — -(x — t) 2 + - t 2 , so (B) 



oo '2 

The last integral is so because with x' = x — t, dx' = dx, we get /_ e~z x dx' = 1. Thus for 
N(0,1), M x (t) = C m e tx N(0,l)dx = ^e^ 2 = E[e tx ]. Combining (A) with (B) we get: 

1 1 

^gtGt+ox)] = e ^E\e atx \ = e^e2 at \ thus, M x=M+(7t (t) = £ [e^+^j = e ^ + 2 <j2t2 , 

but now for the normal density N(pi, a). We will see this result when we deal with a simple stochastic 
differential equation (SDE) for Brownian motion (or stocks). Let [i = 0. 

i 1 1 /l \ 1 3 

M at (t) = e^ 2 = 1 + - CT 2 t 2 + -(-a 2 t 2 ) + 0(t 2 ) = 1 + -a 2 t 2 + -a 4 t 4 + 0(t 2 ) 

_ y M,(0) 

Z, r! 

r=0 

So the variance of x with this density is E[x 2 ] = Var(x) = a 2 , and E[x 4 ] = 3a 4 , and so on by 
reading off the successive terms ( the statistical moments about the mean ) from the MGF series. Thus 
the romance of X 2 is E[X 2 ] = Var(Z 2 ) = E[X 4 ] - (E [X 2 ]) 2 = 2a 4 . Let's put all of this crap together 
for once and all. 

A Brownian motion (drunken sailor). For each t > the random variable W(t) = W(t) — 
W(0) is the (drunken) increment in time [0, t] where the increments are Gaussian increments with 
mean zero, variance t, and with density 

f{x)=—=e a 2 ^f{t,x) = -=e t =— e 2t. 
a^2n V277t ylnt 

That is, AW = W(t + t) - W(t ) ~* N(0, Vt). (What does this? Drunken sailors walking in one or 
more dimensions, neutrons diffusing in a star, and approximately stock prices. Physicists extract the 
mean (first moment about the origin) and variance (second moment about the mean) by Monte Carlo. 
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By definition we have set £[I/K(t)] = 0. By definition we have set a W (t) = Vt- Then plugging 
into the definition of variance of W(t), we have Var(W(t)) = E[W 2 (t) - (g[IV(0]) a ] = £ [W 2 (t)] = 
°w(t) = f - Plugging into the definition of variance for (W 2 (t)), we have Var(W 2 (t)) = E[W 4 (t) — 
(E[W 2 (t)]) 2 ] = E[W 4 (i) - t 2 ] = E[3t 2 - t 2 ] = It 2 . I got the 3t 2 term by translating the result for 
E[X 2 ] = Var(Z 2 ) = E[X 4 ] - (E[X 2 ]) 2 = 2<r 4 above. (Remember that in a Brownian process 
(Feynman's drunken sailor a 2 = t. So er 4 = t 2 .) 

Thus for < t « 1, t » t 2 , and Var(W 2 (t)) = 2t 2 « Var(W(t)) = E[W 2 (t)] = t. With a 
fine enough partition of P n of a time interval [0, t] we see what is called the quadratic variation of 
Brownian motion . 

n n 
^[AW(t;)] 2 = ^At, =t. 

i=l i=l 

Theorem— 2f=i[AVK(tj)] 2 = Z? =1 At; = t in probability 3 max|t; - | -» VP n . (Proof see 
above— screw measure theory in the absence of context). 

This result is used in a key theorem of the Ito calculus and in measure theoretic integration theory. Let's 
get to Ito's lemma. (A Weiner process/Brownian motion are the same thing.) 

Ito's lemma. Given a Weiner process AW = JV(0,l)VAt, let Ax = a(x, t)At + b(x, t)AW. Then 



E[Ax] = aAt since b(x, t)E[AW] = 0, and Var(Ax) = b 2 At. Thus a = VVar(Ax) = byfi. Say 
G = G(x,y) with no stochastic attribute for now. Then 



dG dG 1 d 2 G 2 1 d 2 G 1 d 2 G 

dx ^ X + dy ^ + 2 dx 2 ^ X + 2 3xdy + 2 dy 2 



AG = — Ax + — Ay + -■ — T Ax 2 + -■ — — AxAy + -■ —rAy 2 + Higher Order (H.O. terms). 

2 dx z , 

dG , . dG 



For small Ax, Ay, AG « — dx + ^;dy. Now suppose Ax = (x, t)At + b(x, t)N(0,l)vAt . Then 
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Ax 2 = a 2 (x, t)At 2 + aWV(0,l)At2 + 6 2 JV 2 (0,l)At. 



With At 2 « At' « At, Ax 2 * b 2 N 2 (0,l)At. Thus £[Ax 2 ] = Var(Ax) = b 2 At. Also Var(Ax 2 ) = 

E [b 4 N 4 (0,1) At 4 - (E[b 2 N 2 (0,l))At) 2 ] = 2b 4 At 2 (we've just derived this above, but now the time 

interval At is included). As a result of this (and At » At 2 for small t) we may treat Ax A 2 as non- 
stochastic with mean b 2 dt as At -> 0. (We dropped the variance term of Ax thanks to the quadratic 
variation of the random walk we are working with.) With G = G(x, t), taking limits as Ax -> dx, At -> 
dt we get (KEEPING ONLY FIRST POWERS OF DIFFERENTIALS, e.g., dx, dt but dropping dx 2 , dy 2 , dxdy) 



dG dG 1 d 2 G , dG dG 1 d 2 G , 
dG = —dx + —dt + ---—dx 2 = —dx + —dt + - ■ —-b 2 dt. 
dx dt 2 dx z dx dt 2 ox / 



Cool result. With dx = adt + bdW, we get: 



dG dG 1 d 2 G , /dG dG 1 d 2 G 9 \ dG 

dG=-(adt + ^) + -dt + - — Z, 2 dt= _ a + - + -.^ Z, 2 )dt + -bdW. 



So what? Ito's lemma allows us to deduce the moments of an arbitrary function G(x, t) where x is 
following a stochastic Brownian motion! This is powerful. Stock prices can be approximated by 
Brownian motion. Derivative instruments are financial instruments defined as functions of time t and 
the stochastic (Brownian process) price x. The drift rate of G(x, t) is 



dG + dG 1 d 2 G b2 
dx dt 2 dx 2 



(and looking at the coefficient for dW) the variance rate is 



d 2 G , 
b 2 . 

dx 2 
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This is one of the theoretical bases for pricing derivatives (sensible derivatives based on some stochastic 
process which doesn't have to be Brownian, a Langevin process say. Derivatives based on BS are 
dangerous.) Other ways to extract moments are Monte Carlo simulation (you must have good random 
number generators), binary trees, and trinary trees (equivalent to finite difference methods for PDEs). 
There is a beautiful mapping of the heat equation to the Black-Scholes equation for call and put options. 

Example 3— A variation of an Orhstein-Uhlenbeck (father of the H-bomb) mean reverting process. Let 

dx(t) = -f3x(t)dt + ^2f3o 2 dW, x(0) = x , f3,o = constants. 
Find the mean, variance and probability density function of the process analytically— no computers! 

(dx) = -f3{x)dt + 

since (dW) = 0. 




dt. 



Thus, (x(t)) = (x )e P l ', the mean is E(x) = E(x )e ^ t . The variance is Var[x] = (x 2 ) — (x) 2 . Recall 
Ito's lemma. With dx(t) = a(x(t), t)dt + b(x(t), t)dW, 

dF[x(tlt] = ^- + a- + ^jdt + t-dW. 

Comparing the equation for dx(t) at the top with the equation just above this line, we see that 

a = -fix, b = V2/?ct 2 . 
If F[x(t), t] = x 2 say, (with DF = dx 2 ) then 
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dF = (o + 2ax + ^b 2 ■ 2^J dt + b ■ 2xdW = (2ax + b 2 )dt + 2bxdW. 
Plugging our results for a and b into the equation above leads to 

dF = dx 2 = (-2/?x 2 + 2pa 2 )dt + 2j2pa 2 xdW. 



So, 



{dx 2 } = -2/3(x 2 )dt + 2/3o 2 dt + 2^2f3o 2 {9&m) 
{dx 2 ) = -2/?<x 2 >dt + 2$o 2 dt. 



Then 



d{x 2 ) 

-^+2/?<x 2 ) = 2/?a 2 . 



Thus with integrating factor: [L = eh 2 P t = e 2 ^ 1 we have 

e 2/? t ^!> + e 2/?t (x 2 ) = 2/?(7 2 e 2/?t_ 

at 

So ^[<x 2 )e 2 ^] = 2/3o 2 e 2 P t . Integrating we get: 

j d(x 2 e 2 ^) = 2/3a 2 j' e 2 ^ = 2/3a 2 [^(e 2/?t - l)]- 

So (x 2 )e 2 P t — c = o 2 (e 2 P l — l), where c is a constant. Now the initial condition (x 2 (0)) = (x 2 ) = 
+ ce~ 2 P L So, E[x 2 ] = {x 2 ) = ct 2 (1 - e~ 2 ^) + {xl)e~ 2pt . Therefore Var[x] = E[x 2 ] - (E[x]) 2 
a 2 + (a 2 + (x ) 2 e- 2 ^) + {x^e' 2 ^ = a 2 + «x 2 > - (x > 2 - a 2 ) e - 2 ^. So Var[x] = Var[x - 
CT 2j e -2/?t + a 2 We see ^ tne density associated with the corresponding Fokker-Planck equation. 



Some (optional) Background on Fokker-Planck equation . ("A modern course in statistical 
physics," L. E. Reichl, University of Texas Press, 1980.) (Graduate school level statistical physics.) The 
Master equation is 



dP 1 



j iW(y 1 ,y 2 )P 1 (y 1 (t) - W 2 {y 2l y 1 )P 1 {y l t)}dy, 



where P 1 is the density for a Brownian particle and W accounts for the conditional, or transmitted 
density per unit time. This process is stationary if Pi(y, t) = P(y{) (no time dependence). Ifthe 
transitions W are small we get the Fokker-Planck equation 



dP x d 
~~dF~ ~di 



1 d 2 
2"dy~ 2 



«i (y)Pi (y,t) + - ■ ^ [a 2 (y)P 2 (y, t)] 



Where a n is the n th order jump moment. If particle collisions are restricted to being binary, we get the 
restricted Boltzmann (Vlasov) equation: 



dt 



+ u-V/ + ^-V u / = | d 3 ai j dfilu-UilfMC/A'-//!)- 



Detailed balance means ff x = ff[. This leads to the H-theorem (which leads to the approach to 
equilibrium). A Hamiltonian may supply the transition matrix, e.g., BBGKY. END. 

The Fokker-Planck equation (FPE) governs the transport of the probability density for a given 
stochastic process. For a general diffusion process, dx i = D t dt + EdW^ 

This process maps to the FPE as 



dP d f 1 d 2 , _ . 
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For our Orhstein-Uhlenbeck process dx = —fixdt + ^]2f3o 2 dW, we have D = —fix, E 
^jlfio 2 , and 



dP d 1 d 2 

_ = __(_^ P)+ _._ (2 ^ P) . 



We shall solve this PDE by the Fourier transform method. 





\ dp ) 






i 


r« z , l 


5 


[at J 


= 5 









aP 



ax 



+ /3a 2 (-ik)P, 



where / = £ (xP). Note that g [g] = (-ifc)F = (-ifc)[xP(x)] = (-ife) g], where g[ 5 (x)] 
XT g{x)e lkx dx = g(x). So our equation becomes 



dP dP 



a first-order ODE. The method of characteristics is appropriate. Let P be constant along the 
characteristics 



u(k, t,P) = a = constant, 
v(k, t, P) = b = constant. 



Then, 



du du du dk du dP 
dt~^t + dk'dl + 'dP^t~ ' 



dv dv dv dk dv dP 
dt~^t + dk"dt + dP^t~°' 



Along the characteristics we require the reparameterization 



dk 

This implies that dt = —, or 

p K. 



dP , dfc 



dP 

dt = 



f3o 2 k 2 P 



dP dk. du, dv 

along the characteristic. Check: Plug — , — , dt into the equations for — and — . 

dt dt dt dt 



du du _ du ^ 



— + /3k — + l3a 2 -^rP = 0. 
dt H dk H dP 



Now if u = P = v = P= constant along the characteristic, we see that our pair of equations above 
becomes 



dP dP , „ 

— + (3k- — -l3o 2 k 2 P = 0, 
at a/e 



Recovering the original equation. Therefore along these characteristics a general solution exits as 
f(u, v) = 0. We get 



dk 

dt =w 



Thus k = e^. Also 
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dk _ dP 
pk~~ /3a 2 k 2 P' 

0-2 ^2 

Thus a 2 kdk = -dP/P. So ln(p) = -^ 2 /^ 2 and P = P e~~. WLOG let P = 1- Let a = 6 = 1, 
then since u = u(k, t, P) and v = v(k, t, P), set 



u 



{t,k,P) = et St e-t 3t = ke~l it = 1, 



g 2 /c 2 g 2 /c 2 g 2 /c 2 
v(t,k,P) = e 2 e 2 = p e 2 = 1. 



The general solution can be written as v = g(u) where g(u) is an arbitrary function. We have 

_ 2 2 fc 2 

P(k, t) = e 2 g^ke'Pt). With initial condition (I.C.) P(x, 0|x , t ) = 5(x - x ), we get 



(7 2 fe 2 

P(fc,t) = e~—g(k) = e ikx °. 



This implies that g{k) = e ^ +to °. Finally, P{k, t\k , t ) = ^^(i-e^V^e-^) invert this 

PCx^lXo^o)^^-^-^)^-^ 
J — oo 

^ CO ^ CO 

= e- ikx e- 2k2 e- Sk dk= I dke~ ikx G(k)F{k) =%- 1 [G(k)F(k)] 

J — 00 ■/— oo 

i r°° 



By convolution. FINALLY 



. (x-x e A (-/?At) 2 
P(x,t|x , to ) = e ~ . 

V27r(l-e- 2 ^> 2 



(Abstraction for the sake of efficient exploration is fine if it has good foundations). Thanks. A. Alaniz. 
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Some final thoughts. We humans have compiled a pretty good smallish set of engineering 
manuals that span from the minutia of particles and fields all the way to the observable cosmos and all 
things in between that we can engineer and/or model from space stations to play stations and DNA logic 
gates, stars and nuclear devices, weather patterns and stock markets. For me these notes mark my 
attempt to understand as much of observational phenomenology as possible with the least amount of 
mathematical machinery that maximizes the unity of ideas while minimizing prescriptive, voodoo 
mathematics. Without, however, having a background covering the gamut of nuclear weapons design 
physics from high explosive physics to radiation transport and the numerical methods techniques 
inherent in simulating these kinds of weapons, my experience at DARHT, in molecular dynamics and 
financial physics ranging from natural gas derivatives to climatology, and much other sundry experience, 
these notes would be no more to me than a meatless skeleton devoid of any intuition that comes from 
painstaking struggle and eventual hands on familiarity. At a minimum, core graduate physics courses 
supply sufficient foundations. 

The extremes of our knowledge small and large apply far beyond the everyday engineering 
world. We don't need to know about quarks to make refrigerators or lunar bases or to design genetic 
corrections. Isn't a smallish codification of observation what many physicists have dreamt of? In this 
sense there is a great measure of completeness for me in these notes bounding what we know, but I 
also know that the extremes of our knowledge are vanishingly small. The Lie groups that we use to 
codify known particles and fields can be embedded in far larger, far richer Lie groups allowing us to 
theorize about possible extensions of our universe, or other possible universes. The border separating 
what we know, moreover, from what might be possible is our empirical knowledge, and it's getting ever 
harder to generate fundamental data. The LHC is a monster in terms of international cost. Progress will 
be made, but is it asymptotically bound to practical limits from cost to technology? Indeed progress 
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might also be bound by physics itself, if, say, we build a big enough machine to start making little, 
rapidly evaporating black holes. 

Beyond the semi-intuitive theoretical extensions of our Standard Model to larger, higher- 
dimensional Lie groups, (beyond this set of "core" notes) there are other relatively intuitive extensions 
to consider. There is the text by M. Nakahara, "Geometry, Topology, and Physics", 2 nd ed. It reaches out 
"linearly" to generalizations of the covariant derivative for example, but it also tickles the edge of chaos 
where theoretical physics and pure mathematics merge into the wild, wild west. "The Knot Book, An 
Elementary Introduction to the Mathematical Theory of Knots," C. C. Adams, treating mostly two- 
dimensional knots in our usual three-dimensional space seems to me to be somewhat like genetics. 
How many different genera has nature concocted from a set of merely four letters? How far will we 
humans and our descendants be able to take this four letter alphabet beyond cats who glow with the 
genes of bioluminescent sea life? How many different classification schemes will lead to light in knot 
theory? By surfaces, by simplexes, by crossing numbers, by Conway's notation, by polynomials, 
etcetera, etcetera, etcetera? How much of this is mathematics? How much of this stuff at and beyond 
three dimensions is actually taken advantage of by physics? Read up on, "The Jones polynomial and 
quantum field theory," by E. Witten, Communications in mathematical physics, 121, 351-399 (1989). 
How many ways can string theorists fold higher dimensional manifolds? The degrees of freedom of 
mathematics seem to greatly exceed the explanatory needs of physics running up as it is against brick 
walls in costs and potential deserts of no new physics beyond the Standard Model up to some unknown 
energy threshold. 
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